Enrico Ottonello
|
b0f113c25a
|
heap space set to 4g
|
2021-12-10 11:30:14 +01:00 |
Enrico Ottonello
|
0029b3de33
|
removed unused components
|
2021-12-09 22:36:05 +01:00 |
Enrico Ottonello
|
4797cc460b
|
changed log level
|
2021-12-09 22:21:04 +01:00 |
Enrico Ottonello
|
1ffc8d4945
|
set heap space to 8g avoiding oom; exceptions handling inside scraping loop
|
2021-12-09 21:33:49 +01:00 |
Enrico Ottonello
|
081d3dabc8
|
wf set for ped
|
2021-12-09 21:30:41 +01:00 |
Enrico Ottonello
|
4269e2f0d1
|
added citation retrieving and conversion; added ped test
|
2021-12-09 14:59:01 +01:00 |
Enrico Ottonello
|
76161fd6df
|
added jackson jars 2.9.6 as not provided
|
2021-12-07 17:07:12 +01:00 |
Enrico Ottonello
|
8f3cc81940
|
set with disprot parameters
|
2021-12-07 17:05:57 +01:00 |
Enrico Ottonello
|
a9a4901802
|
configuration set to java action
|
2021-12-07 14:48:28 +01:00 |
Enrico Ottonello
|
6bd84678ca
|
PED test
|
2021-12-06 18:22:37 +01:00 |
Enrico Ottonello
|
83d5e165a7
|
modified wf configuration; added bmuse scraping on a spark action
|
2021-12-03 15:44:39 +01:00 |
Enrico Ottonello
|
ff530fdcb4
|
added profile parameter to wf to choose the conversion model
|
2021-12-01 12:36:30 +01:00 |
Enrico Ottonello
|
b8fe62469c
|
integration of bmuse tool and rdf conversion for bioschema harvesting
|
2021-12-01 11:10:08 +01:00 |
Claudio Atzori
|
0df9574a6f
|
Merge pull request '[stats wf] Added sprint 3&4 of indicators' (#166) from antonis.lempesis/dnet-hadoop:beta into beta
Reviewed-on: D-Net/dnet-hadoop#166
|
2021-11-29 10:40:26 +01:00 |
Claudio Atzori
|
014e872ae1
|
[resolution wf] added optional parameter to skip the entity resolution
|
2021-11-26 15:38:56 +01:00 |
Claudio Atzori
|
5c6d328537
|
code formatting
|
2021-11-26 15:38:16 +01:00 |
dimitrispie
|
09fc2afdca
|
Added indi_funder_country_collab
Kept only indi_pub_has_cc_licence
|
2021-11-26 16:13:10 +02:00 |
dimitrispie
|
8750a71502
|
Merge remote-tracking branch 'origin/beta' into beta
|
2021-11-26 16:11:26 +02:00 |
dimitrispie
|
25fc8abf77
|
Sprint 4
|
2021-11-26 16:10:58 +02:00 |
Antonis Lempesis
|
0b4163ee0b
|
added sprint3,4, removed 2, chaos
|
2021-11-26 15:58:01 +02:00 |
dimitrispie
|
29f69f2f89
|
Sprint 4
|
2021-11-26 15:22:04 +02:00 |
Sandro La Bruzzo
|
bb7f556eff
|
Merge remote-tracking branch 'origin/beta' into beta
|
2021-11-25 13:03:25 +01:00 |
Sandro La Bruzzo
|
1e1f5e4fe0
|
minor fix
|
2021-11-25 13:03:17 +01:00 |
Miriam Baglioni
|
ac07ed8251
|
Merge branch 'beta' of https://code-repo.d4science.org/D-Net/dnet-hadoop into beta
|
2021-11-25 12:32:58 +01:00 |
Miriam Baglioni
|
5fd0e610bf
|
[DOIBOOST Process] fix filtering to filter results with non null id
|
2021-11-25 12:10:45 +01:00 |
Sandro La Bruzzo
|
feea154e89
|
remove working dir after test
|
2021-11-25 11:02:38 +01:00 |
Sandro La Bruzzo
|
028a8acad8
|
add test resources
|
2021-11-25 10:54:47 +01:00 |
Sandro La Bruzzo
|
2164a2a889
|
Datacite: Code Refactor generated a general SparkApplication Scala where all the spark scala have to inherit
Commented a little the Datacite transformation code
|
2021-11-25 10:54:13 +01:00 |
Sandro La Bruzzo
|
a7cf277d98
|
Datacite: Removed HostedBy Patch as described on ticket #7219, Now all the records will have hosted by Unknown Repository
|
2021-11-22 16:03:17 +01:00 |
Sandro La Bruzzo
|
483d3039d1
|
entity resolution: added distcpt of missing entities in graph materialization
|
2021-11-22 15:55:24 +01:00 |
Sandro La Bruzzo
|
93fe8ce8b2
|
entity resolution: fix test
|
2021-11-22 15:50:43 +01:00 |
Sandro La Bruzzo
|
35e20b0647
|
updated resolution wf:
- generate a new version of the graph
- changed merge from union to join
|
2021-11-22 11:48:55 +01:00 |
Miriam Baglioni
|
fdb75b180e
|
[Cleaning] added couple of tests for DOIBOOST publications
|
2021-11-21 16:35:22 +01:00 |
Sandro La Bruzzo
|
6110a2b984
|
reverted version
|
2021-11-19 15:31:45 +01:00 |
Sandro La Bruzzo
|
65ebe1019b
|
updated wagon-ssh version
|
2021-11-19 14:59:04 +01:00 |
Sandro La Bruzzo
|
155d8bf83f
|
updated maven site plugin on dhp-code-style
|
2021-11-19 14:51:08 +01:00 |
Sandro La Bruzzo
|
3426451d3f
|
Merge remote-tracking branch 'origin/beta' into beta
|
2021-11-19 14:49:04 +01:00 |
Sandro La Bruzzo
|
75298ec442
|
added site.xml to code style
|
2021-11-19 14:48:44 +01:00 |
Sandro La Bruzzo
|
4542a2338b
|
updated site configuration to deploy on website
|
2021-11-19 13:44:08 +01:00 |
Claudio Atzori
|
90c2a4987e
|
Merge pull request '[fix] preserve parent/child relations from OpenOrgs' (#164) from preserve_openorg_parent_child_relations into beta
Reviewed-on: D-Net/dnet-hadoop#164
|
2021-11-19 11:35:55 +01:00 |
Claudio Atzori
|
e5a2c596b2
|
Merge branch 'beta' into preserve_openorg_parent_child_relations
|
2021-11-19 11:35:46 +01:00 |
Claudio Atzori
|
f4538f3c4c
|
cleanup
|
2021-11-19 11:33:10 +01:00 |
Claudio Atzori
|
2b46b87f56
|
fixed filtering criteria applied in SparkCopyRelationsNoOpenorgs to keep the parent/child relations from OpenOrgs
|
2021-11-19 11:30:29 +01:00 |
Sandro La Bruzzo
|
fc03c99805
|
fixed javadocs url after deploying site
|
2021-11-19 10:46:33 +01:00 |
Sandro La Bruzzo
|
8a7c7d36db
|
Merge pull request 'mvn_site_documentation' (#161) from mvn_site_documentation into beta
Reviewed-on: D-Net/dnet-hadoop#161
|
2021-11-19 09:54:53 +01:00 |
Sandro La Bruzzo
|
0c0d561bc4
|
added public class into tests to create correct javadoc
|
2021-11-19 09:54:22 +01:00 |
Claudio Atzori
|
62fa61f3cf
|
merge from beta
|
2021-11-19 09:23:42 +01:00 |
Claudio Atzori
|
bd9a43cefd
|
Revert to 4094f2bb9a
|
2021-11-19 09:20:43 +01:00 |
Claudio Atzori
|
a24b9f8268
|
[dedup] trivial refactoring
|
2021-11-18 17:12:02 +01:00 |
Claudio Atzori
|
c0750fb17c
|
avoid non necessary count operations over large spark datasets
|
2021-11-18 17:11:31 +01:00 |