lsmyrnaios
/
dnet-hadoop
forked from D-Net/dnet-hadoop
1
0
Fork 0
Code Pull Requests Activity
5,569 Commits 68 Branches 18 Tags 877 MiB
Commit Graph

5569 Commits

Author SHA1 Message Date
Giambattista Bloisi 8f0d1c2c9e Merge pull request 'Support for JDK 17 and s3 default file system (kubernetes environment)' (#495) from kubernetes into beta 
Reviewed-on: D-Net/dnet-hadoop#495
 2025-01-13 14:16:51 +01:00
Giambattista Bloisi 357ec7414c Remove global kryo serializer 2025-01-13 12:13:03 +01:00
Giambattista Bloisi 79e4728afd Use json loading in place of text loading + jackson mapper 2025-01-13 12:13:03 +01:00
Giambattista Bloisi 1a3fc87599 Import cnr-rmi-api project, rename it dnet-rmi-api and use jakarta and metro in place of javax for portability to java 17 2025-01-13 12:13:01 +01:00
Giambattista Bloisi 7dfb311661 New CopyEntitiesSparkJob as replacement to distcp for copying intermediate graph data 2025-01-13 12:11:52 +01:00
Giambattista Bloisi 35c287c766 Include graph-mapper in shaded package 2025-01-13 12:11:52 +01:00
Giambattista Bloisi 9a6d44c5b4 Support for empty value of master option 2025-01-13 12:11:52 +01:00
Giambattista Bloisi bd8af33850 Give a base path to FileSystem.get to resolve s3 file system 2025-01-13 12:11:52 +01:00
Giambattista Bloisi 62bb82a8ef incremental/export_hive job has to clean propagation context 2025-01-13 12:10:03 +01:00
Giambattista Bloisi ffc7488257 Changes required to run cleaning workflow with spark 3.4 2025-01-10 13:20:05 +01:00
sandro.labruzzo 759e060451 code formatted 2025-01-07 09:34:25 +01:00
Claudio Atzori a6da42a2e8 Merge pull request 'Update Gtr2 plugin' (#518) from beta-ukripublication into beta 
Reviewed-on: D-Net/dnet-hadoop#518
 2024-12-20 10:11:34 +01:00
Claudio Atzori 7ff4111357 Merge pull request 'ConnectSubCommunities' (#523) from COnnectSubCommunities into beta 
Reviewed-on: D-Net/dnet-hadoop#523
 2024-12-20 10:11:13 +01:00
Miriam Baglioni 849b75593e resolved conflicts 2024-12-20 09:21:22 +01:00
Miriam Baglioni 2d45f125a7 [bulktag subcommunities] refactoring and addition of new properties 2024-12-20 09:06:55 +01:00
Giambattista Bloisi 3ad3a56868 Merge pull request 'Implement new jobs for constructing the graph incrementally' (#522) from incremental_graph into beta 
Reviewed-on: D-Net/dnet-hadoop#522
 2024-12-19 15:14:41 +01:00
Giambattista Bloisi 85dced4ffb Implement new jobs for collecting data from latest graph on hive and deltas from oaf mdstores (datacite and crossref) 
Optimized CopyHdfsOafSparkApplication
 2024-12-19 14:37:48 +01:00
sandro.labruzzo dccbcfd36c code formatted 2024-12-13 11:48:32 +01:00
sandro.labruzzo b039952d97 bug fixed on zenodo plugin 2024-12-13 10:43:27 +01:00
Miriam Baglioni 29a2a29666 Merge pull request '[research_fi] added plugin name to collectorplugins' (#519) from beta_researchfi into beta 
Reviewed-on: D-Net/dnet-hadoop#519
 2024-12-12 09:12:05 +01:00
Miriam Baglioni 1b1fb9f1c2 [research_fi] added plugin name to collectorplugins 2024-12-11 16:38:02 +01:00
Miriam Baglioni ce22b1d536 [gtr2 plugin] changed to try not to die if one publication link point to the website of the project 2024-12-11 16:33:51 +01:00
Giambattista Bloisi 101d9e830d JsonListMatch do not lower the extracted strings 
Fix test configurations and assertions
 2024-12-11 15:59:13 +01:00
Miriam Baglioni 19a9bddab1 [gtr2 plugin] changed to try not to die if one publication link point to the website of the project 2024-12-10 16:26:24 +01:00
Miriam Baglioni 69dad7e2bf [gtr2 plugin] removed unused import 2024-12-10 14:17:34 +01:00
Miriam Baglioni 9657707ab0 [gtr2 plugin] changed according to the new apis endpoint and response 2024-12-10 14:15:38 +01:00
Sandro La Bruzzo dd6ed31383 Merge remote-tracking branch 'origin/beta' into beta 2024-12-06 14:23:58 +01:00
Sandro La Bruzzo 0d05006114 code formatted 2024-12-06 14:23:47 +01:00
Claudio Atzori e4b814b3f1 code formatting 2024-12-06 13:58:39 +01:00
Claudio Atzori 5c7f7fb3b8 Merge pull request 'Add Collector Plugin for Zenodo Dumps' (#516) from zenodo_dump_collection into beta 
Reviewed-on: D-Net/dnet-hadoop#516
 2024-12-06 13:51:10 +01:00
Claudio Atzori 9e6b1f2f24 Merge pull request 'Communities_patents' (#514) from Communities_patents into beta 
Reviewed-on: D-Net/dnet-hadoop#514
 2024-12-06 13:50:43 +01:00
Miriam Baglioni 666155bafa [communityfromsemrelpropagation] changed resource to have deletedbyinference = false. 2024-12-06 12:26:41 +01:00
Miriam Baglioni ee84db7a6a [communityfromsemrelpropagation] added filtering to remove the deletedbyinference and invisible results 2024-12-06 12:20:13 +01:00
Claudio Atzori 77308ed525 Merge pull request 'Crossref Enhancements:' (#511) from crossref_mapping_improvement into beta 
Reviewed-on: D-Net/dnet-hadoop#511
 2024-12-06 11:48:57 +01:00
Miriam Baglioni 302c4d044e Merge branch 'beta' into crossref_mapping_improvement 2024-12-06 11:45:37 +01:00
Claudio Atzori 60da306830 Merge pull request 'raid actionset wf' (#517) from raid_actionset into beta 
Reviewed-on: D-Net/dnet-hadoop#517
 2024-12-06 10:04:20 +01:00
Claudio Atzori 8a5ba8df45 minor changes 2024-12-06 10:03:11 +01:00
Claudio Atzori dade7d5bb8 minor changes 2024-12-06 10:02:07 +01:00
Claudio Atzori f57446ad16 merge from beta 2024-12-06 09:50:42 +01:00
Michele De Bonis 1c144a4dcb minor change 2024-12-06 09:18:10 +01:00
Sandro La Bruzzo fd1038b44d removed a sneaky break that was committed by mistake. 2024-12-06 09:12:06 +01:00
Giambattista Bloisi fed13e083e Fix: do not import joda 
formatting
 2024-12-05 15:21:32 +01:00
Michele De Bonis 6af3fd16b6 attributes fixes 2024-12-05 14:39:42 +01:00
Michele De Bonis bde59a7c8f implementation of the utilities for the inclusion of raids in the graph 2024-12-05 11:09:30 +01:00
sandro.labruzzo 730a7751b6 added zenodoDump to enum of CollectorPlugin 2024-12-04 15:03:59 +01:00
Miriam Baglioni 89b7bc84f2 Merge pull request 'support of the new research.fi apis' (#515) from update_researchfi_plugin into beta 
Reviewed-on: D-Net/dnet-hadoop#515
 2024-12-04 13:53:01 +01:00
sandro.labruzzo 5f134c4045 Merge remote-tracking branch 'origin/beta' into zenodo_dump_collection 2024-12-04 13:41:25 +01:00
sandro.labruzzo 4034da7579 code formatted 2024-12-04 13:37:14 +01:00
sandro.labruzzo 32e2a8b340 implemented zenodo dump collector plugin 2024-12-04 13:36:21 +01:00
Michele Artini 65902a87e3 support of the new apis 2024-12-04 13:18:17 +01:00