Serafeim Chatzopoulos
|
60f25b780d
|
Minor fixes in workflow.xml and job.properties
|
2023-06-23 12:51:50 +03:00 |
 Ilias Kanellos
|
a1b9187039
|
Fix syntax error on workflow.xml
|
2023-05-23 17:17:12 +03:00 |
|
Ilias Kanellos
|
6a7e370a21
|
Remove unnecessary counts in graph creation
|
2023-05-23 16:48:58 +03:00 |
|
Ilias Kanellos
|
ec4e010687
|
End after rankings | Create graph debugged
|
2023-05-23 16:44:04 +03:00 |
|
Ilias Kanellos
|
38020e242a
|
Merge branch '8172_impact_indicators_workflow' of https://code-repo.d4science.org/D-Net/dnet-hadoop into 8172_impact_indicators_workflow
|
2023-05-16 17:34:53 +03:00 |
|
Ilias Kanellos
|
3d69f33c84
|
Fix selection of columns in graph creation
|
2023-05-16 17:34:42 +03:00 |
|
Ilias Kanellos
|
3c38f7ba6f
|
Fix selection of columns in graph creation
|
2023-05-16 17:32:53 +03:00 |
|
Serafeim Chatzopoulos
|
8ef718c363
|
Fix workflow application path
|
2023-05-16 16:28:48 +03:00 |
|
Serafeim Chatzopoulos
|
26328e2a0d
|
Move job.properties
|
2023-05-16 14:39:53 +03:00 |
|
Serafeim Chatzopoulos
|
4eec3e7052
|
Add jobTracker, nameNode && spark2Lib as global params in oozie wf
|
2023-05-15 22:28:48 +03:00 |
|
Serafeim Chatzopoulos
|
b83135c252
|
Add missing kill nodes in workflow.xml
|
2023-05-15 19:55:35 +03:00 |
|
Serafeim Chatzopoulos
|
45f2aa0867
|
Move end node ... at the end in workflow.xml
|
2023-05-15 17:52:20 +03:00 |
|
Serafeim Chatzopoulos
|
12a57e1f58
|
Resolve conflicts
|
2023-05-15 16:20:11 +03:00 |
|
Serafeim Chatzopoulos
|
82e2a96f51
|
Resolve conflicts
|
2023-05-15 15:53:12 +03:00 |
|
Serafeim Chatzopoulos
|
b8e8c959fe
|
Update workflow.xml && job.properties
|
2023-05-15 15:50:23 +03:00 |
|
Ilias Kanellos
|
4a905932a3
|
Spark properties from job.properties
|
2023-05-15 15:24:22 +03:00 |
|
Serafeim Chatzopoulos
|
07818131ef
|
Update documentation
|
2023-05-15 13:04:44 +03:00 |
|
Ilias Kanellos
|
1788ac2d4d
|
Correct filtering for MAG records
|
2023-05-12 12:55:43 +03:00 |
|
Ilias Kanellos
|
5ddbb4ad10
|
Spark properties no longer hardcoded
|
2023-05-11 15:36:47 +03:00 |
|
Ilias Kanellos
|
3de35fd6a3
|
Produce 5 classes of ranking scores
|
2023-05-11 14:42:25 +03:00 |
|
Ilias Kanellos
|
90332439ad
|
Remove deletion of synonym folder
|
2023-04-28 13:45:19 +03:00 |
|
Ilias Kanellos
|
a98da54896
|
Merge branch '8172_impact_indicators_workflow' of https://code-repo.d4science.org/D-Net/dnet-hadoop into 8172_impact_indicators_workflow
|
2023-04-28 13:23:49 +03:00 |
|
Ilias Kanellos
|
09485fbee3
|
Fixed unicode bug. Workflow ends after first script
|
2023-04-28 13:09:13 +03:00 |
|
Serafeim Chatzopoulos
|
614cc1089b
|
Add separate forder for results && project actionsets
|
2023-04-27 12:37:15 +03:00 |
|
Serafeim Chatzopoulos
|
815a4ddbba
|
Add actionset creation for project bip indicators in workflow
|
2023-04-26 20:40:06 +03:00 |
|
Serafeim Chatzopoulos
|
ee04cf92bf
|
Add actionsets for project impact indicators
|
2023-04-26 20:23:46 +03:00 |
|
Serafeim Chatzopoulos
|
23f58a86f1
|
Change jar param in project impact indicators action
|
2023-04-18 12:26:01 +03:00 |
|
Serafeim Chatzopoulos
|
7256c8d3c7
|
Add script for aggregating impact indicators at the project level
|
2023-04-07 16:30:12 +03:00 |
|
Serafeim Chatzopoulos
|
102aa5ab81
|
Add dependency to dhp-aggregation
|
2023-03-21 19:25:29 +02:00 |
|
Serafeim Chatzopoulos
|
f3e5abf63b
|
Merge branch '8172_impact_indicators_workflow' of https://code-repo.d4science.org/D-Net/dnet-hadoop into 8172_impact_indicators_workflow
|
2023-03-21 18:26:09 +02:00 |
|
Serafeim Chatzopoulos
|
3e8a4cf952
|
Rearrange resources folder structure
|
2023-03-21 18:25:55 +02:00 |
|
Serafeim Chatzopoulos
|
f992ecb657
|
Checkout BIP-Ranker during 'prepare-package' && add it in the oozie-package.tar.gz
|
2023-03-21 18:03:55 +02:00 |
|
Ilias Kanellos
|
9dc8f0f05f
|
Add ActionSet step
|
2023-03-21 16:14:15 +02:00 |
|
Ilias Kanellos
|
b5c252865c
|
Add filtering based on citation source
|
2023-03-20 15:38:36 +02:00 |
|
Serafeim Chatzopoulos
|
720fd19b39
|
Add dhp-impact-indicators workflow files
|
2023-03-14 19:28:27 +02:00 |
|
Serafeim Chatzopoulos
|
c6e39b7f33
|
Add dhp-impact-indicators
|
2023-03-14 18:50:54 +02:00 |
 Miriam Baglioni
|
588aca5ce4
|
Merge pull request 'h2020classification' (#280) from h2020classification into beta
Reviewed-on: #280
|
2023-03-03 09:29:10 +01:00 |
 Claudio Atzori
|
8ec0d62d91
|
pre-group the records in each table before joning the contents from BETA and PROD together
|
2023-03-02 14:49:19 +01:00 |
|
Miriam Baglioni
|
0fff98a14c
|
[ECclassification] removed print
|
2023-03-02 11:46:57 +01:00 |
|
Miriam Baglioni
|
b0c2f7e526
|
[ECclassification] removed not needed resources
|
2023-03-02 11:44:48 +01:00 |
|
Miriam Baglioni
|
d4fc62c2f6
|
mergin with branch beta
|
2023-03-02 11:14:54 +01:00 |
|
Miriam Baglioni
|
de8ad1caef
|
[ECclassification] new implementation for the H2020 classification
|
2023-03-02 11:14:03 +01:00 |
|
Claudio Atzori
|
db9dad4aa7
|
[actionmanager] increased spark.sql.shuffle.partitions for publication, dataset, relation records
|
2023-03-02 09:11:37 +01:00 |
|
Miriam Baglioni
|
c1f9848953
|
[ECclassification] added new classes
|
2023-03-01 15:29:11 +01:00 |
|
Claudio Atzori
|
6f488547a7
|
ignore non processable records
|
2023-03-01 14:49:51 +01:00 |
|
Claudio Atzori
|
7d263f265e
|
adjusted logs
|
2023-03-01 11:58:07 +01:00 |
|
Claudio Atzori
|
16ad42e8f3
|
code formatting
|
2023-03-01 10:22:13 +01:00 |
|
Claudio Atzori
|
9c59dac859
|
followup changes reorganising the mdstore synchronisation mechanism
|
2023-03-01 10:16:20 +01:00 |
|
Miriam Baglioni
|
49737f1087
|
Merge pull request '[CrossrefFunderMapping] fixed issueson funder name' (#279) from doiboostFunderExtention into beta
Reviewed-on: #279
|
2023-02-28 15:08:07 +01:00 |
|
Miriam Baglioni
|
ad745c0aa3
|
[CrossrefFunderMapping] fixed issueson funder name
|
2023-02-28 14:58:27 +01:00 |