przemyslaw.jacewicz
/
dnet-hadoop
forked from D-Net/dnet-hadoop
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

Commit Graph

  • 3c38f7ba6f Fix selection of columns in graph creation Ilias Kanellos 2023-05-16 17:32:53 +0300
  • 8ef718c363 Fix workflow application path Serafeim Chatzopoulos 2023-05-16 16:28:48 +0300
  • 26328e2a0d Move job.properties Serafeim Chatzopoulos 2023-05-16 14:39:38 +0300
  • 4eec3e7052 Add jobTracker, nameNode && spark2Lib as global params in oozie wf Serafeim Chatzopoulos 2023-05-15 22:28:48 +0300
  • b83135c252 Add missing kill nodes in workflow.xml Serafeim Chatzopoulos 2023-05-15 19:55:35 +0300
  • 45f2aa0867 Move end node ... at the end in workflow.xml Serafeim Chatzopoulos 2023-05-15 17:52:20 +0300
  • e309688711 Merge pull request 'fix APC affiliation links' (#294) from apc_affiliation into beta Claudio Atzori 2023-05-15 15:47:57 +0200
  • 8acad52a0c Merge branch 'beta' into apc_affiliation Claudio Atzori 2023-05-15 15:47:33 +0200
  • 8a463cc3e8 fixed organization id created when mapping APC affiliations. Factored out ROR constants in dhp-common Claudio Atzori 2023-05-15 15:44:46 +0200
  • 12a57e1f58 Resolve conflicts Serafeim Chatzopoulos 2023-05-15 15:59:51 +0300
  • 82e2a96f51 Resolve conflicts Serafeim Chatzopoulos 2023-05-15 15:53:12 +0300
  • b8e8c959fe Update workflow.xml && job.properties Serafeim Chatzopoulos 2023-05-15 15:50:23 +0300
  • 4a905932a3 Spark properties from job.properties Ilias Kanellos 2023-05-15 15:24:22 +0300
  • 0c314d5e09 Merge pull request 'Update copyDataToImpalaCluster.sh' (#293) from antonis.lempesis/dnet-hadoop:beta into beta Claudio Atzori 2023-05-15 12:05:54 +0200
  • 07818131ef Update documentation Serafeim Chatzopoulos 2023-05-15 13:04:44 +0300
  • b3f9633205 Update copyDataToImpalaCluster.sh dimitrispie 2023-05-15 12:51:44 +0300
  • 021321ae06 Merge pull request 'removed the inverse of the Citing relation' (#292) from citeOnly into beta Miriam Baglioni 2023-05-15 11:37:39 +0200
  • 78b07400c0 changed test classes Miriam Baglioni 2023-05-15 11:37:08 +0200
  • 86fe886c1a removed the inverse of the Citing relation Miriam Baglioni 2023-05-15 11:20:51 +0200
  • 1788ac2d4d Correct filtering for MAG records Ilias Kanellos 2023-05-12 12:55:43 +0300
  • 12cd179d2d Merge pull request 'Update copyDataToImpalaCluster.sh' (#291) from antonis.lempesis/dnet-hadoop:beta into beta Miriam Baglioni 2023-05-12 11:36:34 +0200
  • 00d0d162b6 Update copyDataToImpalaCluster.sh dimitrispie 2023-05-12 12:31:13 +0300
  • 5ddbb4ad10 Spark properties no longer hardcoded Ilias Kanellos 2023-05-11 15:36:47 +0300
  • 3de35fd6a3 Produce 5 classes of ranking scores Ilias Kanellos 2023-05-11 14:42:25 +0300
  • 8c05f49665 moved the version as it was before the change Miriam Baglioni 2023-05-09 10:48:34 +0200
  • 99ac5bab46 added check to avoid NPE when checking the organization country Miriam Baglioni 2023-05-04 19:38:39 +0200
  • 0704e186f6 Merge pull request 'Stats wf executed on hive only' (#283) from antonis.lempesis/dnet-hadoop:beta into beta Claudio Atzori 2023-05-02 14:05:12 +0200
  • cd80b200ee Merge pull request 'Affiliation links from APC' (#290) from apc_affiliation into beta Claudio Atzori 2023-05-02 12:00:04 +0200
  • d8882c4481 extended mapping applied to datacite records to produce affiliations using the ROR ids. Inc ase of APCs it includes the amount and the currently in the relation Claudio Atzori 2023-05-02 11:56:51 +0200
  • d02916ef82 code formatting Claudio Atzori 2023-05-02 11:05:37 +0200
  • f653640cd9 Merge pull request 'Bulk Tagging single step' (#289) from bulkTagRefactor into beta Claudio Atzori 2023-05-02 10:54:14 +0200
  • c3d58e58e1 Bug fixes dimitrispie 2023-05-02 11:54:07 +0300
  • abd7ca0c18 Merge branch 'beta' into bulkTagRefactor Claudio Atzori 2023-05-02 10:50:01 +0200
  • de36c7b083 Merge pull request 'Enrichment - result to community through organization' (#255) from organizationToRepresentative into beta Claudio Atzori 2023-05-02 10:47:07 +0200
  • 45f625d14f Merge branch 'beta' into organizationToRepresentative Claudio Atzori 2023-05-02 10:46:55 +0200
  • cdd33f7445 Merge pull request 'graph cleaning refactoring' (#282) from graph_cleaning_refactoring into beta Claudio Atzori 2023-05-02 10:40:02 +0200
  • de11edca98 Merge branch 'beta' into organizationToRepresentative Claudio Atzori 2023-05-02 09:59:41 +0200
  • 851f664bd9 Merge branch 'beta' into graph_cleaning_refactoring Claudio Atzori 2023-05-02 09:55:40 +0200
  • e57ecdaf98 Update step20-createMonitorDB.sql dimitrispie 2023-04-30 17:52:23 +0300
  • 90332439ad Remove deletion of synonym folder Ilias Kanellos 2023-04-28 13:45:19 +0300
  • a98da54896 Merge branch '8172_impact_indicators_workflow' of https://code-repo.d4science.org/D-Net/dnet-hadoop into 8172_impact_indicators_workflow Ilias Kanellos 2023-04-28 13:23:49 +0300
  • 09485fbee3 Fixed unicode bug. Workflow ends after first script Ilias Kanellos 2023-04-28 13:09:13 +0300
  • 614cc1089b Add separate forder for results && project actionsets Serafeim Chatzopoulos 2023-04-27 12:37:15 +0300
  • 815a4ddbba Add actionset creation for project bip indicators in workflow Serafeim Chatzopoulos 2023-04-26 20:40:06 +0300
  • ee04cf92bf Add actionsets for project impact indicators Serafeim Chatzopoulos 2023-04-26 20:23:46 +0300
  • b88f009d9f combined level 4 and 6 for the demo Alessia Bardi 2023-04-24 12:10:33 +0200
  • 5ffe82ffd8 aligned to current DMF index layout on production Alessia Bardi 2023-04-24 12:09:55 +0200
  • 1c173642f0 removed level5 from test records Alessia Bardi 2023-04-24 09:32:32 +0200
  • fdb5d2b39f Bug fixes dimitrispie 2023-04-23 18:29:00 +0300
  • 53ce023035 Bug fixes dimitrispie 2023-04-23 18:22:26 +0300
  • 382f46a8e4 tests to generate the XML records for the index for the EDITH demo on digital twins, integrating output from the FoS classifier Alessia Bardi 2023-04-21 16:46:30 +0200
  • ce03f3ee62 mergin with branch beta Miriam Baglioni 2023-04-20 14:50:47 +0200
  • 4fa750b719 Bug fixes on monitor-update dimitrispie 2023-04-19 17:39:53 +0300
  • 5247cb7115 Bug fix dimitrispie 2023-04-19 11:11:19 +0300
  • efc4f6a658 [bulkTag] refactor to enrich each result single step Miriam Baglioni 2023-04-18 17:39:31 +0200
  • 23f58a86f1 Change jar param in project impact indicators action Serafeim Chatzopoulos 2023-04-18 12:26:01 +0300
  • 73f77575bd [ZenodoApiClient] align with master version Miriam Baglioni 2023-04-18 10:25:27 +0200
  • 697a134504 - Miriam Baglioni 2023-04-18 10:21:12 +0200
  • 6cc95c96a2 - Miriam Baglioni 2023-04-18 09:53:11 +0200
  • 24c41806ac [ZenodoApiClienttest] change test to mirror change in the omplementation Miriam Baglioni 2023-04-18 09:08:09 +0200
  • 087b5a7973 [ZenodiAPIClient] new version of the API to connect to Zenodo (change the http client Miriam Baglioni 2023-04-17 18:59:22 +0200
  • cb595c87bb implementation of the support for authors deduplication: cosinesimilarity comparator and double array json parser Michele De Bonis 2023-04-17 11:06:27 +0200
  • 25dafccc24 Merge branch 'hive' into beta dimitrispie 2023-04-12 11:36:59 +0300
  • 688e3b7936 added eoscifguidelines in the result view; removed compute statistics statements Claudio Atzori 2023-04-11 10:43:32 +0200
  • 2e465915b4 [graph to Solr] using dedicated sparkExecutorCores, sparkExecutorMemory, sparkDriverMemory in convert_to_xml Claudio Atzori 2023-03-24 13:43:20 +0100
  • a2dcb06daf added eoscifguidelines in the result view; removed compute statistics statements Claudio Atzori 2023-04-11 10:43:32 +0200
  • 7256c8d3c7 Add script for aggregating impact indicators at the project level Serafeim Chatzopoulos 2023-04-07 16:30:12 +0300
  • c85de8fa1f -Added Technological University Dublin -Added project_organization_contribution table -Add Delft University of Technology dimitrispie 2023-04-07 09:22:59 +0300
  • 9b41dff33c Update step20-createMonitorDB.sql dimitrispie 2023-04-07 09:21:38 +0300
  • 4a4ca634f0 Merge pull request 'advConstraintsInBeta' (#288) from advConstraintsInBeta into master Claudio Atzori 2023-04-06 15:24:23 +0200
  • 932d07d2dd [bulkTag] added filtering for datasources in eosctag Miriam Baglioni 2023-04-06 15:08:27 +0200
  • c6a7602b3e refactoring after compilation Miriam Baglioni 2023-04-06 14:45:01 +0200
  • 831055a1fc change of the property for test purposes, addition of two new verbs, and fix of issue for advanced constraints Miriam Baglioni 2023-04-06 14:41:32 +0200
  • 287753417d better implementation for the fix Miriam Baglioni 2023-04-06 12:22:38 +0200
  • cf3d0f4f83 fixed issue on bulktagging for the advanced constraints Miriam Baglioni 2023-04-06 12:17:35 +0200
  • b42abc9904 fixed issue on bulktagging for the advanced constraints Miriam Baglioni 2023-04-06 12:15:00 +0200
  • 91e18ac7f4 Added project_organization_contribution table dimitrispie 2023-04-06 10:53:11 +0300
  • 4f67225fbc Merge pull request 'doiboostMappingExtention' (#286) from doiboostMappingExtention into master Claudio Atzori 2023-04-06 09:25:08 +0200
  • e093f04874 Merge pull request 'AdvancedConstraint' (#285) from advConstraintsInBeta into master Claudio Atzori 2023-04-06 09:24:54 +0200
  • c5a9f39141 Extended the association project - result in the mapping from CrossRef Miriam Baglioni 2023-04-05 16:48:36 +0200
  • ecc05fe0f3 Added the code for the advancedConstraint implementation during the bulkTagging Miriam Baglioni 2023-04-05 16:40:29 +0200
  • 42442ccd39 Merge pull request 'updated the order of the compatibilities' (#275) from compatibility_order into master Claudio Atzori 2023-04-05 12:44:14 +0200
  • b25b401065 added test to verify the advconstraints to dth community. inserted some additional logs. Miriam Baglioni 2023-04-05 12:18:39 +0200
  • 864f4051d3 [graph cleaning] added missing case Claudio Atzori 2023-04-05 11:35:47 +0200
  • 297eb207a5 minor change in the author match which now can compute count and percentage Michele De Bonis 2023-04-04 17:10:37 +0200
  • dead87917f [graph cleaning] cleanup Claudio Atzori 2023-04-04 13:13:43 +0200
  • 2a6ba29b64 [graph cleaning] unit tests & cleanup Claudio Atzori 2023-04-04 12:34:51 +0200
  • 9e1335df4c -Added Technological University Dublin -Added project_organization_contribution table dimitrispie 2023-04-04 13:22:40 +0300
  • 9a9cc6a1dd changed the way the tar archive is build to support renaming in case we need to change .tt.gz into .json.gz Miriam Baglioni 2023-04-04 11:40:58 +0200
  • 63b8bbc015 [graph to Solr] using dedicated sparkExecutorCores, sparkExecutorMemory, sparkDriverMemory in convert_to_xml Claudio Atzori 2023-03-24 13:43:20 +0100
  • b502f86523 fixed input path supplemented to GetDatasourceFromCountry; adjusted the various spark.sql.shuffle.partitions Claudio Atzori 2023-03-24 13:09:12 +0100
  • c07857fa37 [graph cleaning] unit tests & cleanup Claudio Atzori 2023-03-23 15:57:47 +0100
  • 90e61a8aba [graph cleaning] WIP: refactoring of the cleaning stages, unit tests Claudio Atzori 2023-03-23 15:03:26 +0100
  • 308e10d102 serialising: 1. measures for all the entity types and 2. result level fulltext Claudio Atzori 2023-03-23 11:23:22 +0100
  • 488d9a5eaa [graph cleaning] WIP: refactoring of the cleaning stages, unit tests Claudio Atzori 2023-03-23 10:41:13 +0100
  • fad7fa4af8 Added Technological University Dublin dimitrispie 2023-03-22 09:44:00 +0200
  • 102aa5ab81 Add dependency to dhp-aggregation Serafeim Chatzopoulos 2023-03-21 19:25:29 +0200
  • f3e5abf63b Merge branch '8172_impact_indicators_workflow' of https://code-repo.d4science.org/D-Net/dnet-hadoop into 8172_impact_indicators_workflow Serafeim Chatzopoulos 2023-03-21 18:26:09 +0200
  • 3e8a4cf952 Rearrange resources folder structure Serafeim Chatzopoulos 2023-03-21 18:24:12 +0200
  • f992ecb657 Checkout BIP-Ranker during 'prepare-package' && add it in the oozie-package.tar.gz Serafeim Chatzopoulos 2023-03-21 18:03:55 +0200