giambattista.bloisi
created branch pivotselectionbypid in D-Net/openaire-graph-docs
2024-05-29 23:18:49 +02:00
giambattista.bloisi
pushed to pivotselectionbypid at D-Net/openaire-graph-docs
2024-05-29 23:18:49 +02:00
30f2cca3df
Change the selection criteria for the pivot record of a group so that by best pid type becomes the first criteria. This will have the effect to slowly converge to records having DOI pid
73316d8c83
Add jaxb and jaxws dependencies when compiling with spark-34 profile as they are required to run with jdk > 8
WIP: playing with dependencies to compile also with macos arm64 and openjdk 11 or 17
@alessia.bardi I just merged in beta PR #327 that solves part of the problems. A new profile, -P spark-34, can be used to activate building against spark 3.4.2.openaire that has recently been…
1b2357e10a
Merge pull request 'Changes in maven poms to build and test the project using Spark 3.4.x and scala 2.12' (#327) from spark34-integration into beta
f1fe363b19
merged again from beta (I hope for the last time)
66c1ffc866
merged again from beta (I hope for the last time)
103e2652b3
merged beta
a87f9ea643
fixed scholexplorer bug
Changes in maven poms to build and test the project using Spark 3.4.x and scala 2.12
75b1cdf92e
Describe the usage of the pivot table to improve stability of “representative records” and how “non authoritative” PIDs are used to generate “representative records”
b7cb15e942
Update affiliation matching page in v7.1.3
c017c95486
Adjust text in affiliation matching page
4cdb5f7f31
affiliation matching description update
f279cdfe10
affiliation matching description update
6b3533d29a
Describe the usage of the pivot table to improve stability of “representative records” and how “non authoritative” PIDs are used to generate “representative records”
Fixes in Graph Provision
giambattista.bloisi
pushed to beta_provision_relation at D-Net/dnet-hadoop
2024-05-07 15:44:42 +02:00
711048ceed
PrepareRelationsJob rewritten to use Spark Dataframe API and Windowing functions
giambattista.bloisi
created branch beta_provision_relation in D-Net/dnet-hadoop
2024-05-07 15:44:42 +02:00
69c5efbd8b
Fix: when applying enrichments with no instance information the resulting merge entity was generated with no instance instead of keeping the original information
Miscellaneous related to changes in MergeUtils
giambattista.bloisi
created branch misc_fixes_merge_entities in D-Net/dnet-hadoop
2024-04-24 08:12:53 +02:00
giambattista.bloisi
pushed to misc_fixes_merge_entities at D-Net/dnet-hadoop
2024-04-24 08:12:53 +02:00
1878199dae
Miscellaneous fixes:
Describe OpenAIRE ID stability and usage of Pivot table
giambattista.bloisi
created branch pid_stability in D-Net/openaire-graph-docs
2024-04-22 22:04:28 +02:00
6bb810a606
Describe the usage of the pivot table to improve stability of “representative records” and how “non authoritative” PIDs are used to generate “representative records”
9222fe3456
Format md
giambattista.bloisi
pushed to airflow at giambattista.bloisi/lot1-kickoff
2024-04-18 13:13:19 +02:00
09b603925d
initial stage