Commit Graph

5561 Commits

Author SHA1 Message Date
Claudio Atzori 8a8a99325e [aggrgator graph] a bit of schema evolution tolerance in the step responsible to merge the claim with the graph records 2025-01-09 21:06:58 +01:00
Claudio Atzori 3549b6976d removed dataset caching as it seems to impact too much on the memory footprint 2025-01-08 15:44:58 +01:00
Claudio Atzori 6c31fddd03 path existance works with globs, graph creation workflow to specify driver and executor memory overhead 2025-01-07 10:48:37 +01:00
Claudio Atzori a6da42a2e8 Merge pull request 'Update Gtr2 plugin' (#518) from beta-ukripublication into beta
Reviewed-on: #518
2024-12-20 10:11:34 +01:00
Claudio Atzori 7ff4111357 Merge pull request 'ConnectSubCommunities' (#523) from COnnectSubCommunities into beta
Reviewed-on: #523
2024-12-20 10:11:13 +01:00
Miriam Baglioni 849b75593e resolved conflicts 2024-12-20 09:21:22 +01:00
Miriam Baglioni 2d45f125a7 [bulktag subcommunities] refactoring and addition of new properties 2024-12-20 09:06:55 +01:00
Giambattista Bloisi 3ad3a56868 Merge pull request 'Implement new jobs for constructing the graph incrementally' (#522) from incremental_graph into beta
Reviewed-on: #522
2024-12-19 15:14:41 +01:00
Giambattista Bloisi 85dced4ffb Implement new jobs for collecting data from latest graph on hive and deltas from oaf mdstores (datacite and crossref)
Optimized CopyHdfsOafSparkApplication
2024-12-19 14:37:48 +01:00
sandro.labruzzo dccbcfd36c code formatted 2024-12-13 11:48:32 +01:00
sandro.labruzzo b039952d97 bug fixed on zenodo plugin 2024-12-13 10:43:27 +01:00
Miriam Baglioni 29a2a29666 Merge pull request '[research_fi] added plugin name to collectorplugins' (#519) from beta_researchfi into beta
Reviewed-on: #519
2024-12-12 09:12:05 +01:00
Miriam Baglioni 1b1fb9f1c2 [research_fi] added plugin name to collectorplugins 2024-12-11 16:38:02 +01:00
Miriam Baglioni ce22b1d536 [gtr2 plugin] changed to try not to die if one publication link point to the website of the project 2024-12-11 16:33:51 +01:00
Giambattista Bloisi 101d9e830d JsonListMatch do not lower the extracted strings
Fix test configurations and assertions
2024-12-11 15:59:13 +01:00
Miriam Baglioni 19a9bddab1 [gtr2 plugin] changed to try not to die if one publication link point to the website of the project 2024-12-10 16:26:24 +01:00
Miriam Baglioni 69dad7e2bf [gtr2 plugin] removed unused import 2024-12-10 14:17:34 +01:00
Miriam Baglioni 9657707ab0 [gtr2 plugin] changed according to the new apis endpoint and response 2024-12-10 14:15:38 +01:00
Sandro La Bruzzo dd6ed31383 Merge remote-tracking branch 'origin/beta' into beta 2024-12-06 14:23:58 +01:00
Sandro La Bruzzo 0d05006114 code formatted 2024-12-06 14:23:47 +01:00
Claudio Atzori e4b814b3f1 code formatting 2024-12-06 13:58:39 +01:00
Claudio Atzori 5c7f7fb3b8 Merge pull request 'Add Collector Plugin for Zenodo Dumps' (#516) from zenodo_dump_collection into beta
Reviewed-on: #516
2024-12-06 13:51:10 +01:00
Claudio Atzori 9e6b1f2f24 Merge pull request 'Communities_patents' (#514) from Communities_patents into beta
Reviewed-on: #514
2024-12-06 13:50:43 +01:00
Miriam Baglioni 666155bafa [communityfromsemrelpropagation] changed resource to have deletedbyinference = false. 2024-12-06 12:26:41 +01:00
Miriam Baglioni ee84db7a6a [communityfromsemrelpropagation] added filtering to remove the deletedbyinference and invisible results 2024-12-06 12:20:13 +01:00
Claudio Atzori 77308ed525 Merge pull request 'Crossref Enhancements:' (#511) from crossref_mapping_improvement into beta
Reviewed-on: #511
2024-12-06 11:48:57 +01:00
Miriam Baglioni 302c4d044e Merge branch 'beta' into crossref_mapping_improvement 2024-12-06 11:45:37 +01:00
Claudio Atzori 60da306830 Merge pull request 'raid actionset wf' (#517) from raid_actionset into beta
Reviewed-on: #517
2024-12-06 10:04:20 +01:00
Claudio Atzori 8a5ba8df45 minor changes 2024-12-06 10:03:11 +01:00
Claudio Atzori dade7d5bb8 minor changes 2024-12-06 10:02:07 +01:00
Claudio Atzori f57446ad16 merge from beta 2024-12-06 09:50:42 +01:00
Michele De Bonis 1c144a4dcb minor change 2024-12-06 09:18:10 +01:00
Sandro La Bruzzo fd1038b44d removed a sneaky break that was committed by mistake. 2024-12-06 09:12:06 +01:00
Giambattista Bloisi fed13e083e Fix: do not import joda
formatting
2024-12-05 15:21:32 +01:00
Michele De Bonis 6af3fd16b6 attributes fixes 2024-12-05 14:39:42 +01:00
Michele De Bonis bde59a7c8f implementation of the utilities for the inclusion of raids in the graph 2024-12-05 11:09:30 +01:00
sandro.labruzzo 730a7751b6 added zenodoDump to enum of CollectorPlugin 2024-12-04 15:03:59 +01:00
Miriam Baglioni 89b7bc84f2 Merge pull request 'support of the new research.fi apis' (#515) from update_researchfi_plugin into beta
Reviewed-on: #515
2024-12-04 13:53:01 +01:00
sandro.labruzzo 5f134c4045 Merge remote-tracking branch 'origin/beta' into zenodo_dump_collection 2024-12-04 13:41:25 +01:00
sandro.labruzzo 4034da7579 code formatted 2024-12-04 13:37:14 +01:00
sandro.labruzzo 32e2a8b340 implemented zenodo dump collector plugin 2024-12-04 13:36:21 +01:00
Michele Artini 65902a87e3 support of the new apis 2024-12-04 13:18:17 +01:00
sandro.labruzzo cc6bbbb804 make setter void 2024-12-03 14:31:11 +01:00
sandro.labruzzo 0517e452e3 Fixed error on empty affiliation 2024-12-02 14:00:59 +01:00
Miriam Baglioni ca2d480df3 [BulkTagging] added fix to consider when the set of constraints for the datasource is empty. Added check for remove constraints and advanced constraints to verify if the constraints list is empty and in that case do nothing 2024-11-26 15:56:52 +01:00
Claudio Atzori 2e54715d71 Applying PR#512 - Sequential ActionSet promotion 2024-11-26 15:56:46 +01:00
Miriam Baglioni 189a7c255a [patents] added test and resources 2024-11-25 16:52:13 +01:00
Miriam Baglioni 821700299a [patents] added test and resources 2024-11-22 17:21:58 +01:00
Miriam Baglioni 2570023590 [Subcommunities] modified bulktagging workflow to include the new parameters 2024-11-21 14:47:17 +01:00
Miriam Baglioni c0729ac279 [Subcommunities] added remapping to master datasource 2024-11-21 14:36:26 +01:00