WIP: Graph footprint optimisation #287

Draft
claudio.atzori wants to merge 39 commits from ticket_8369 into beta

39 Commits

Author SHA1 Message Date
Alessia Bardi af1f8af788 Updated officialnmae of pangaea in hostedbymap for Datacite to avoid duplicate entries in the source filter of the portal 2023-06-07 10:29:47 +02:00
Sandro La Bruzzo 883dcd910e Make the tests compilable 2023-05-10 09:05:23 +02:00
Sandro La Bruzzo 706631586b Now it compiles 2023-05-09 13:54:57 +02:00
Sandro La Bruzzo ba380f5826 Makes the code compilable 2023-05-09 12:23:42 +02:00
Sandro La Bruzzo 88fffa6dbd - Removed ModelConstants and update Relation enum 2023-05-03 14:03:01 +02:00
Sandro La Bruzzo f8f4b9a018 -Renamed RelationInverse into RelationLabel.
-Removed findRelation from ModelSupport
-code formatted
2023-04-28 11:44:28 +02:00
Claudio Atzori 8c9a77d7eb WIP merged from graph_cleaning_refactoring, applying model simplification 2023-04-26 16:02:06 +02:00
Claudio Atzori cdb5aad82b merge from beta 2023-04-21 08:47:47 +02:00
Claudio Atzori 864f4051d3 [graph cleaning] added missing case 2023-04-05 11:35:47 +02:00
Claudio Atzori dead87917f [graph cleaning] cleanup 2023-04-04 13:13:43 +02:00
Claudio Atzori 2a6ba29b64 [graph cleaning] unit tests & cleanup 2023-04-04 12:34:51 +02:00
Claudio Atzori b502f86523 fixed input path supplemented to GetDatasourceFromCountry; adjusted the various spark.sql.shuffle.partitions 2023-03-24 13:09:12 +01:00
Claudio Atzori c07857fa37 [graph cleaning] unit tests & cleanup 2023-03-23 15:57:47 +01:00
Claudio Atzori 90e61a8aba [graph cleaning] WIP: refactoring of the cleaning stages, unit tests 2023-03-23 15:03:26 +01:00
Claudio Atzori 488d9a5eaa [graph cleaning] WIP: refactoring of the cleaning stages, unit tests 2023-03-23 10:41:13 +01:00
Claudio Atzori 4f5ba0ed52 [graph cleaning] WIP: refactoring of the cleaning stages, unit tests 2023-03-21 14:41:20 +01:00
Claudio Atzori 6d3d18d8b5 [graph cleaning] WIP: refactoring of the cleaning stages 2023-03-16 17:23:36 +01:00
Claudio Atzori c3dff7e199 Merge branch 'beta' into ticket_8369 2023-03-14 15:24:03 +01:00
Claudio Atzori 2a914e4463 merged from beta. It compiles 2023-03-10 16:00:48 +01:00
Claudio Atzori 74c40fd4e2 Merge branch 'ticket_8369' of https://code-repo.d4science.org/D-Net/dnet-hadoop into ticket_8369 2023-02-17 10:59:40 +01:00
Miriam Baglioni eca7ebab6d [enrichment] adding relations in one side only 2023-02-15 16:41:28 +01:00
Miriam Baglioni 624c62f62d [enrichment] changed to make it compile against the new model 2023-02-15 16:20:24 +01:00
Miriam Baglioni 8ddcf10075 resolved conflicts 2023-02-15 15:30:17 +01:00
Claudio Atzori 56495cc727 Merge branch 'ticket_8369' of https://code-repo.d4science.org/D-Net/dnet-hadoop into ticket_8369 2023-02-15 11:39:36 +01:00
Sandro La Bruzzo 8af8b2ea27 Now Crossref mapping and dhp-aggregation compile 2023-02-14 17:20:13 +01:00
Claudio Atzori 6b0a08e29c Merge branch 'ticket_8369' of https://code-repo.d4science.org/D-Net/dnet-hadoop into ticket_8369 2023-02-14 15:59:18 +01:00
Sandro La Bruzzo 990e3e2f60 code refactor 2023-02-14 10:32:17 +01:00
Sandro La Bruzzo 8f777af827 increased version number of dhp-code-style 2023-02-14 10:30:34 +01:00
Claudio Atzori 63c5c5848d wip: large refactoring 2023-02-13 16:15:19 +01:00
Miriam Baglioni 125657ed4c - 2023-02-13 12:40:14 +01:00
Claudio Atzori 508648e1d8 Merge branch 'ticket_8369' of https://code-repo.d4science.org/D-Net/dnet-hadoop into ticket_8369 2023-02-09 16:27:46 +01:00
Claudio Atzori d04610480a wip: large refactoring 2023-02-09 16:27:41 +01:00
Sandro La Bruzzo 6bd5a792dd Added vocabolary mocks 2023-02-09 16:13:34 +01:00
Sandro La Bruzzo 04b12a35cd Moved cressref Utility to dhp-aggregation 2023-02-09 16:11:59 +01:00
Claudio Atzori 934c1846f8 wip: large refactoring 2023-02-09 12:32:28 +01:00
Sandro La Bruzzo 606cada7a4 trying to adapt to the new data model 2023-02-07 11:11:05 +01:00
Claudio Atzori d9c9482a5b WIP: refactoring the internal graph data model and its utilities 2023-02-06 13:45:21 +01:00
Claudio Atzori 67735f7e9d WIP: refactoring model utilities 2023-02-02 17:02:23 +01:00
Claudio Atzori 1845dcfedf WIP: refactoring the internal graph data model and its utilities 2023-02-01 16:24:35 +01:00