dnet-hadoop

Commit Graph

Select branches

Hide Pull Requests

beta

convert_hive_to_spark_actions

deduptesting

dhp_oaf_model

dump

forceOrginalId_claims

graph_cleaning

graph_db

hive

master

monitor_dbs

observatory_country

organization_pids

promotion-prod-only

stable_ids

unique_field_in_lists

usage-stats-export-wf-v2

wf-promotion

#1

1.0.1

archive/bipFinder_master_test

archive/dedupTest

archive/islookup_timeout

archive/junit5

archive/master_pre_stable_ids

dhp-1.0.2

dhp-1.0.3

dhp-1.0.4

dhp-1.1.5

dhp-1.1.6

dhp-1.1.7

dhp-1.2.0

dhp-1.2.1

dhp-1.2.2

dhp-1.2.3

dhp-1.2.4

588aca5ce4 Merge pull request 'h2020classification' (#280) from h2020classification into beta Miriam Baglioni 2023-03-03 09:29:10 +0100
8ec0d62d91 pre-group the records in each table before joning the contents from BETA and PROD together Claudio Atzori 2023-03-02 14:49:19 +0100
0fff98a14c [ECclassification] removed print Miriam Baglioni 2023-03-02 11:46:57 +0100
b0c2f7e526 [ECclassification] removed not needed resources Miriam Baglioni 2023-03-02 11:44:48 +0100
d4fc62c2f6 mergin with branch beta Miriam Baglioni 2023-03-02 11:14:54 +0100
de8ad1caef [ECclassification] new implementation for the H2020 classification Miriam Baglioni 2023-03-02 11:14:03 +0100
db9dad4aa7 [actionmanager] increased spark.sql.shuffle.partitions for publication, dataset, relation records Claudio Atzori 2023-03-02 09:11:37 +0100
c1f9848953 [ECclassification] added new classes Miriam Baglioni 2023-03-01 15:29:11 +0100
6f488547a7 ignore non processable records Claudio Atzori 2023-03-01 14:49:51 +0100
7d263f265e adjusted logs Claudio Atzori 2023-03-01 11:58:07 +0100
16ad42e8f3 code formatting Claudio Atzori 2023-03-01 10:22:13 +0100
9c59dac859 followup changes reorganising the mdstore synchronisation mechanism Claudio Atzori 2023-03-01 10:16:20 +0100
49737f1087 Merge pull request '[CrossrefFunderMapping] fixed issueson funder name' (#279) from doiboostFunderExtention into beta Miriam Baglioni 2023-02-28 15:08:07 +0100
ad745c0aa3 [CrossrefFunderMapping] fixed issueson funder name Miriam Baglioni 2023-02-28 14:58:27 +0100
4f2df876cd [ECclassification] new implementation first try Miriam Baglioni 2023-02-28 14:44:00 +0100
bc986f66ec Merge pull request 'monodirectional citations' (#278) from citations_monodirectional into beta Claudio Atzori 2023-02-28 13:33:52 +0100
2f7346e9cf WIP monodirectional citations, Datacite Claudio Atzori 2023-02-28 13:30:51 +0100
0559d8b412 WIP monodirectional citations Claudio Atzori 2023-02-28 10:57:32 +0100
69fa616490 removed wrong content Sandro La Bruzzo 2023-02-28 10:27:38 +0100
832a75d012 added mapping for crossref funder Sandro La Bruzzo 2023-02-28 10:16:34 +0100
78e51c182a Added missing parametero to raw all workflow Sandro La Bruzzo 2023-02-28 10:16:01 +0100
7aebedb43c code formatting Claudio Atzori 2023-02-27 11:51:27 +0100
80987801d7 [FoS] added check for null on level1 subject Miriam Baglioni 2023-02-13 13:03:49 +0100
31e97c2a6b [unresolved entities] updated oozie wf node labels Claudio Atzori 2023-02-27 11:38:29 +0100
23112929e9 [FoS] changed the default separator from comma to tab to solve the issue in subject value split Miriam Baglioni 2023-02-10 15:34:52 +0100
c4856b4eaa Merge pull request 'Remove unecessary indexed fields from Solr' (#277) from 8099_lighten_solr_index into beta Claudio Atzori 2023-02-23 11:50:29 +0100
0b5bf53b45 Remove unecessary indexed fields from Solr Serafeim Chatzopoulos 2023-02-23 12:42:42 +0200
1547611246 Merge branch 'beta' into hive dimitrispie 2023-02-22 16:57:12 +0200
9e4ec0023c Merge pull request 'updated the order of the compatibilities (BETA)' (#276) from compatibility_order_beta into beta Claudio Atzori 2023-02-22 14:47:32 +0100
fddcf701e9 updated the order of the compatibilities Michele Artini 2023-02-22 12:07:09 +0100
200098b683 updated the order of the compatibilities Michele Artini 2023-02-22 11:52:59 +0100
0c1be41b30 code formatting Claudio Atzori 2023-02-22 10:15:25 +0100
3b876d9327 depending on dhp-schemas v. 3.16.0 Claudio Atzori 2023-02-22 10:15:10 +0100
99cd7761aa cleanup of non necessary dhp-monitor-update workflow Claudio Atzori 2023-02-22 10:10:22 +0100
a590c371a9 Merge pull request '8232-mdstore-synch-improve' (#272) from 8232-mdstore-synch-improve into beta Claudio Atzori 2023-02-22 10:02:26 +0100
cd3a51a15f Merge branch 'beta' into 8232-mdstore-synch-improve Claudio Atzori 2023-02-22 09:57:07 +0100
42b6b5d5ce Merge pull request 'UsageCountOnProjectAndDatasource' (#271) from UsageCountOnProjectAndDatasource into beta Claudio Atzori 2023-02-22 09:56:08 +0100
477a7c416f Merge branch 'beta' into UsageCountOnProjectAndDatasource Claudio Atzori 2023-02-22 09:55:51 +0100
c20c1c9159 Merge pull request 'Added 4 institutions:' (#261) from antonis.lempesis/dnet-hadoop:beta into beta Claudio Atzori 2023-02-22 09:53:45 +0100
d617c3e812 [DOIBoost] extended mapping for funder #8407 Miriam Baglioni 2023-02-20 14:45:27 +0100
6b247524a8 Changes in usage stats update wf dimitrispie 2023-02-20 11:49:08 +0200
90807b60c7 Changes to monitor wf dimitrispie 2023-02-20 10:42:24 +0200
d2f9ccf934 Changes to separate monitor wf dimitrispie 2023-02-20 10:41:21 +0200
032a401cbf Bug fixes dimitrispie 2023-02-20 09:29:20 +0200
016337a0f9 Merge branch 'beta' of https://code-repo.d4science.org/D-Net/dnet-hadoop into beta Miriam Baglioni 2023-02-16 15:54:59 +0100
118c1fc3b3 Merge remote-tracking branch 'origin/beta' into beta Sandro La Bruzzo 2023-02-15 10:29:28 +0100
a8ac79fa25 Added citation relation on crossref Mapping Sandro La Bruzzo 2023-02-15 10:29:13 +0100
595192d510 Bug fix dimitrispie 2023-02-14 16:24:08 +0200
f3aaff3688 Remove duplicate orgs dimitrispie 2023-02-14 09:48:36 +0200
9a03f71db1 code formatting Claudio Atzori 2023-02-13 16:25:47 +0100
554df257ab null values in date range conditions Michele Artini 2023-02-13 16:05:58 +0100
9c1df15071 null values in date range conditions Michele Artini 2023-02-13 16:05:58 +0100
32870339f5 refactoring after compile Miriam Baglioni 2023-02-13 13:06:48 +0100
7184cc0804 [FoS] added check for null on level1 subject Miriam Baglioni 2023-02-13 13:03:49 +0100
3400133c2f Bug fix dimitrispie 2023-02-13 09:44:00 +0200
935db0ab25 Added organizations for Monitor dimitrispie 2023-02-13 09:29:09 +0200
7b78b15c81 Changes for copying to Impala Cluster dimitrispie 2023-02-13 09:27:00 +0200
5cf902a2b0 [UsageCount] changed query to make the sum be computed via sql instead of grouping Miriam Baglioni 2023-02-10 16:16:37 +0100
f803530df6 [UsageCount] fixed query Miriam Baglioni 2023-02-10 15:50:56 +0100
7473093c84 [FoS] changed the default separator from comma to tab to solve the issue in subject value split Miriam Baglioni 2023-02-10 15:34:52 +0100
b73245eb47 initial changes monitor_dbs Antonis Lempesis 2023-02-10 16:19:55 +0200
bb5bba51b3 [UsageCount] extended test Miriam Baglioni 2023-02-09 19:08:30 +0100
85e53fad00 [UsageCount] addition of usagecount for Projects and datasources. Extention of the action set created for the results with new entities for projects and datasources. Extention of the resource set and modification of the testing class Miriam Baglioni 2023-02-09 18:59:45 +0100
d71f5672d3 Add monitor post step dimitrispie 2023-02-09 13:44:14 +0200
35ba8bb328 Bug fixes dimitrispie 2023-02-09 12:57:57 +0200
8920932dd8 Code formatted Sandro La Bruzzo 2023-02-08 11:34:18 +0100
0b9819f1ab Code formatted Sandro La Bruzzo 2023-02-08 10:32:33 +0100
6c81a161d2 Merge remote-tracking branch 'origin/beta' into 8231-mdstore-synch-improve Sandro La Bruzzo 2023-02-08 10:29:09 +0100
3ba11d64a1 Changes 07022023 dimitrispie 2023-02-07 12:53:51 +0200
98c34263ed Update step20-createMonitorDB.sql dimitrispie 2023-02-07 08:14:48 +0200
2dc6d47270 Changes 06022023 dimitrispie 2023-02-06 13:18:53 +0200
5f0906be60 Merge branch 'master' of https://code-repo.d4science.org/D-Net/dnet-hadoop Miriam Baglioni 2023-02-02 17:13:14 +0100
973d78a4d6 Update step15_5.sql dimitrispie 2023-02-02 08:03:54 +0200
d05ca53a14 Merge branch 'beta' of https://code-repo.d4science.org/D-Net/dnet-hadoop into beta Claudio Atzori 2023-01-31 14:39:53 +0100
6a6c266dde implementation of author dedup configuration and lnfi clustering function Michele De Bonis 2023-01-31 11:53:10 +0100
e82e009b46 added missing close tag for XML produced by the xquery to get information for the community from the IS Miriam Baglioni 2023-01-31 10:19:34 +0100
b254a0375f [Affiliation from institutionalrepo] changed the field to check to verify the datasource type. Now it is in the field jurisdiction Miriam Baglioni 2023-01-26 16:51:20 +0100
cf58e4a5e4 Added Arts et Métiers ParisTech dimitrispie 2023-01-25 16:03:16 +0200
db7d625ba9 Addedd Arts et Métiers ParisTech organization dimitrispie 2023-01-25 12:22:21 +0200
505867bce9 [bulk tagging] better node naming Claudio Atzori 2023-01-20 16:11:26 +0100
1b37516578 [bulk tagging] better node naming Claudio Atzori 2023-01-20 16:11:26 +0100
ecd398fe51 refactoring Miriam Baglioni 2023-01-20 14:23:45 +0100
c1e2460293 [cleaning] the datasource master-duplicate fixup should not be brought to production yet Claudio Atzori 2023-01-20 09:20:26 +0100
3800361033 [country propagation] fixes error 'cannot resolve countrySet given input columns: []' when there is no prepared information driving the propagation process for a given result type Claudio Atzori 2023-01-19 15:57:43 +0100
0a5c6010b0 Merge branch 'beta' of https://code-repo.d4science.org/D-Net/dnet-hadoop into beta Miriam Baglioni 2023-01-13 16:14:46 +0100
566e2459a8 Workflow usage-stats-update created dimitrispie 2023-01-13 15:21:04 +0200
733abdffe3 Changes for Episciences journal dimitrispie 2023-01-13 15:06:08 +0200
4d7553c9f1 Bug fixes dimitrispie 2023-01-12 17:19:19 +0200
dd70c32ad7 Bug fixes dimitrispie 2023-01-12 17:18:05 +0200
51f7ab5864 Bug fixes dimitrispie 2023-01-12 17:15:06 +0200
34d4bf727c Bug fixes dimitrispie 2023-01-12 11:28:37 +0200
43f6d4f296 -Monitor DB workflow dimitrispie 2023-01-12 11:26:47 +0200
686580a220 - New Monitor DB workflow - New Organization added dimitrispie 2023-01-12 11:18:03 +0200
0a58bc7ba7 [broker] prevent NPEs Claudio Atzori 2023-01-11 14:44:14 +0100
699736addc NPE prevention Michele Artini 2023-01-11 13:14:44 +0100
04cb96001c [broker] d40e20f437 adapted to the beta graph model Claudio Atzori 2023-01-11 10:10:12 +0100
91b845f611 Considering instance pids and alteternative identifiers Michele Artini 2023-01-11 09:37:34 +0100
f86e19b282 code formatting Claudio Atzori 2023-01-11 09:53:19 +0100
1f367122e4 Merge branch 'beta' of https://code-repo.d4science.org/D-Net/dnet-hadoop into beta Miriam Baglioni 2023-01-11 09:47:44 +0100
d40e20f437 Considering instance pids and alteternative identifiers Michele Artini 2023-01-11 09:37:34 +0100