lsmyrnaios
/
dnet-hadoop
forked from D-Net/dnet-hadoop
1
0
Fork 0
Code Pull Requests Activity
5,569 Commits 68 Branches 18 Tags 877 MiB
Commit Graph

4654 Commits

Author SHA1 Message Date
Giambattista Bloisi 79e4728afd Use json loading in place of text loading + jackson mapper 2025-01-13 12:13:03 +01:00
Giambattista Bloisi 1a3fc87599 Import cnr-rmi-api project, rename it dnet-rmi-api and use jakarta and metro in place of javax for portability to java 17 2025-01-13 12:13:01 +01:00
Giambattista Bloisi bd8af33850 Give a base path to FileSystem.get to resolve s3 file system 2025-01-13 12:11:52 +01:00
Giambattista Bloisi 62bb82a8ef incremental/export_hive job has to clean propagation context 2025-01-13 12:10:03 +01:00
Giambattista Bloisi ffc7488257 Changes required to run cleaning workflow with spark 3.4 2025-01-10 13:20:05 +01:00
sandro.labruzzo 759e060451 code formatted 2025-01-07 09:34:25 +01:00
Claudio Atzori a6da42a2e8 Merge pull request 'Update Gtr2 plugin' (#518) from beta-ukripublication into beta 
Reviewed-on: D-Net/dnet-hadoop#518
 2024-12-20 10:11:34 +01:00
Miriam Baglioni 849b75593e resolved conflicts 2024-12-20 09:21:22 +01:00
Miriam Baglioni 2d45f125a7 [bulktag subcommunities] refactoring and addition of new properties 2024-12-20 09:06:55 +01:00
Giambattista Bloisi 85dced4ffb Implement new jobs for collecting data from latest graph on hive and deltas from oaf mdstores (datacite and crossref) 
Optimized CopyHdfsOafSparkApplication
 2024-12-19 14:37:48 +01:00
sandro.labruzzo dccbcfd36c code formatted 2024-12-13 11:48:32 +01:00
sandro.labruzzo b039952d97 bug fixed on zenodo plugin 2024-12-13 10:43:27 +01:00
Miriam Baglioni 1b1fb9f1c2 [research_fi] added plugin name to collectorplugins 2024-12-11 16:38:02 +01:00
Miriam Baglioni ce22b1d536 [gtr2 plugin] changed to try not to die if one publication link point to the website of the project 2024-12-11 16:33:51 +01:00
Giambattista Bloisi 101d9e830d JsonListMatch do not lower the extracted strings 
Fix test configurations and assertions
 2024-12-11 15:59:13 +01:00
Miriam Baglioni 19a9bddab1 [gtr2 plugin] changed to try not to die if one publication link point to the website of the project 2024-12-10 16:26:24 +01:00
Miriam Baglioni 69dad7e2bf [gtr2 plugin] removed unused import 2024-12-10 14:17:34 +01:00
Miriam Baglioni 9657707ab0 [gtr2 plugin] changed according to the new apis endpoint and response 2024-12-10 14:15:38 +01:00
Sandro La Bruzzo dd6ed31383 Merge remote-tracking branch 'origin/beta' into beta 2024-12-06 14:23:58 +01:00
Sandro La Bruzzo 0d05006114 code formatted 2024-12-06 14:23:47 +01:00
Claudio Atzori e4b814b3f1 code formatting 2024-12-06 13:58:39 +01:00
Claudio Atzori 5c7f7fb3b8 Merge pull request 'Add Collector Plugin for Zenodo Dumps' (#516) from zenodo_dump_collection into beta 
Reviewed-on: D-Net/dnet-hadoop#516
 2024-12-06 13:51:10 +01:00
Claudio Atzori 9e6b1f2f24 Merge pull request 'Communities_patents' (#514) from Communities_patents into beta 
Reviewed-on: D-Net/dnet-hadoop#514
 2024-12-06 13:50:43 +01:00
Miriam Baglioni 666155bafa [communityfromsemrelpropagation] changed resource to have deletedbyinference = false. 2024-12-06 12:26:41 +01:00
Miriam Baglioni ee84db7a6a [communityfromsemrelpropagation] added filtering to remove the deletedbyinference and invisible results 2024-12-06 12:20:13 +01:00
Miriam Baglioni 302c4d044e Merge branch 'beta' into crossref_mapping_improvement 2024-12-06 11:45:37 +01:00
Claudio Atzori 8a5ba8df45 minor changes 2024-12-06 10:03:11 +01:00
Claudio Atzori dade7d5bb8 minor changes 2024-12-06 10:02:07 +01:00
Claudio Atzori f57446ad16 merge from beta 2024-12-06 09:50:42 +01:00
Michele De Bonis 1c144a4dcb minor change 2024-12-06 09:18:10 +01:00
Sandro La Bruzzo fd1038b44d removed a sneaky break that was committed by mistake. 2024-12-06 09:12:06 +01:00
Giambattista Bloisi fed13e083e Fix: do not import joda 
formatting
 2024-12-05 15:21:32 +01:00
Michele De Bonis 6af3fd16b6 attributes fixes 2024-12-05 14:39:42 +01:00
Michele De Bonis bde59a7c8f implementation of the utilities for the inclusion of raids in the graph 2024-12-05 11:09:30 +01:00
sandro.labruzzo 730a7751b6 added zenodoDump to enum of CollectorPlugin 2024-12-04 15:03:59 +01:00
Miriam Baglioni 89b7bc84f2 Merge pull request 'support of the new research.fi apis' (#515) from update_researchfi_plugin into beta 
Reviewed-on: D-Net/dnet-hadoop#515
 2024-12-04 13:53:01 +01:00
sandro.labruzzo 5f134c4045 Merge remote-tracking branch 'origin/beta' into zenodo_dump_collection 2024-12-04 13:41:25 +01:00
sandro.labruzzo 4034da7579 code formatted 2024-12-04 13:37:14 +01:00
sandro.labruzzo 32e2a8b340 implemented zenodo dump collector plugin 2024-12-04 13:36:21 +01:00
Michele Artini 65902a87e3 support of the new apis 2024-12-04 13:18:17 +01:00
sandro.labruzzo cc6bbbb804 make setter void 2024-12-03 14:31:11 +01:00
sandro.labruzzo 0517e452e3 Fixed error on empty affiliation 2024-12-02 14:00:59 +01:00
Miriam Baglioni ca2d480df3 [BulkTagging] added fix to consider when the set of constraints for the datasource is empty. Added check for remove constraints and advanced constraints to verify if the constraints list is empty and in that case do nothing 2024-11-26 15:56:52 +01:00
Claudio Atzori 2e54715d71 Applying PR#512 - Sequential ActionSet promotion 2024-11-26 15:56:46 +01:00
Miriam Baglioni 189a7c255a [patents] added test and resources 2024-11-25 16:52:13 +01:00
Miriam Baglioni 821700299a [patents] added test and resources 2024-11-22 17:21:58 +01:00
Miriam Baglioni 2570023590 [Subcommunities] modified bulktagging workflow to include the new parameters 2024-11-21 14:47:17 +01:00
Miriam Baglioni c0729ac279 [Subcommunities] added remapping to master datasource 2024-11-21 14:36:26 +01:00
Miriam Baglioni ab96983647 [Subcommunities] added remapping to representative organization 2024-11-21 12:35:05 +01:00
Miriam Baglioni 0656ed568d [Subcommunities] remove not needed methods used to create datasourceCommunityMap 2024-11-21 11:05:58 +01:00