Miriam Baglioni
5022f1b50d
removing organization deletedbyinference from the dump
2021-04-01 18:16:40 +02:00
Miriam Baglioni
0421f5e1d8
added check to verify not to add void APC
2021-04-01 17:38:30 +02:00
Miriam Baglioni
2c209e1140
added resources for testing selection of valid relations
2021-04-01 16:57:34 +02:00
Miriam Baglioni
b3f02083e7
refactoring
2021-04-01 16:56:58 +02:00
Miriam Baglioni
8d28ca9815
added test class for the selection of valid relations
2021-04-01 16:56:32 +02:00
Miriam Baglioni
152ba8e2ef
added description
2021-04-01 16:55:57 +02:00
Miriam Baglioni
c0c225f3b2
added logic to select only the valid relations: those not deletedbyinference and having both part of the relation as entities in the graph
2021-04-01 16:53:33 +02:00
Miriam Baglioni
daabc370c5
changed the workflow to add the step for selecting the valid relations
2021-04-01 16:52:39 +02:00
Miriam Baglioni
f93356f690
refactoring
2021-04-01 16:24:08 +02:00
Miriam Baglioni
f7714645d2
merge with dump
2021-03-30 16:27:38 +02:00
Miriam Baglioni
4632795f25
merge branch with master
2021-03-30 16:27:23 +02:00
Miriam Baglioni
870ee28dd6
refactoring
2021-03-30 12:55:48 +02:00
Miriam Baglioni
08f8dd9454
refactoring
2021-03-30 12:53:07 +02:00
Miriam Baglioni
e5463fea01
added resource for apc dump
2021-03-30 12:47:07 +02:00
Miriam Baglioni
16c1a27852
added test for APC dump
2021-03-30 12:46:42 +02:00
Miriam Baglioni
d0c94462e4
refactoring
2021-03-30 12:45:34 +02:00
Miriam Baglioni
a896febc02
added APC in the dumped information
2021-03-30 11:13:07 +02:00
Miriam Baglioni
5dea729de3
added article processing charges and modified description
2021-03-30 10:49:39 +02:00
Miriam Baglioni
200e7e9c46
modified description
2021-03-30 10:49:15 +02:00
Miriam Baglioni
931b2a2e15
merge branch with master
2021-03-30 10:27:32 +02:00
Miriam Baglioni
4b6e514f02
merge upstream
2021-03-30 10:27:12 +02:00
Claudio Atzori
19f3580b3d
introduced java8-based date parsing
2021-03-11 16:46:23 +01:00
Claudio Atzori
e8789b0cdb
Merge pull request 'stats DB for monitor' ( #99 ) from antonis.lempesis/dnet-hadoop:master into master
...
Looks good to me, just a note on the parsing of the citations: since the last version, IIS produces citations as proper relationships among results. This is what we got already in the BETA graph
```
count r.reltype r.subreltype r.relclass
62.129.254 resultResult citation cites
62.043.309 resultResult citation isCitedBy
```
Thus, I suggest to move away from the current property based implementation for the extraction of the citation links and start relying on the relationships instead.
2021-03-03 10:29:09 +01:00
Antonis Lempesis
27796343ca
crude sleep. hardcoded value
2021-03-03 01:37:47 +02:00
Miriam Baglioni
330343937c
-
2021-02-24 12:49:27 +01:00
Miriam Baglioni
defbb71561
extended resource info to match the new test
2021-02-24 11:52:44 +01:00
Miriam Baglioni
17049f8bde
extended the test class - should have done by the start :)
2021-02-24 11:52:07 +01:00
Miriam Baglioni
cc11ee1cb9
changed the param value to directly upload on Zenodo
2021-02-24 11:51:40 +01:00
Miriam Baglioni
871e5bea29
should have fixed for real now
2021-02-24 11:51:20 +01:00
Miriam Baglioni
5d92df0627
tried again to fix issue for croatian funder
2021-02-24 10:49:55 +01:00
Miriam Baglioni
9841086ef3
modified code to split the Croazian funders
2021-02-23 18:09:14 +01:00
Miriam Baglioni
d4ad740c98
merge branch with master
2021-02-23 11:10:41 +01:00
Miriam Baglioni
a684e1065e
merge branch with master
2021-02-23 10:45:42 +01:00
Miriam Baglioni
896919e735
merge upstream
2021-02-23 10:45:29 +01:00
Antonis Lempesis
d90767c733
correctly invalidating metadata
2021-02-19 03:18:47 +02:00
Antonis Lempesis
3681afbe04
typo
2021-02-19 03:04:27 +02:00
Antonis Lempesis
c5502eba8f
actually moved stats computation in impala instead of hive...
2021-02-19 02:54:39 +02:00
Antonis Lempesis
33c85d4e66
moved stats computation in impala instead of hive
2021-02-18 17:23:34 +02:00
Antonis Lempesis
b8e96c8ae7
moved cache update to the end
2021-02-18 16:42:22 +02:00
Antonis Lempesis
bcbfc052b1
fixed last errors in step 21
2021-02-18 16:32:54 +02:00
Antonis Lempesis
10a29a4b9a
fixes in monitor step
2021-02-18 15:05:59 +02:00
Antonis Lempesis
8ef66452d5
fixed typo
2021-02-17 22:24:44 +02:00
Antonis Lempesis
a8836e2f5f
fixed typo
2021-02-17 19:27:07 +02:00
Antonis Lempesis
a445c1ac3d
fixed variable names in monitor script
2021-02-17 16:45:09 +02:00
Antonis Lempesis
00d516360f
added missing ;
2021-02-17 16:41:10 +02:00
Antonis Lempesis
cd1b794409
added the monitor db wf
2021-02-17 02:11:55 +02:00
Alessia Bardi
bf2830b981
Merge pull request 'manage merging of Relatation validation attributes' ( #95 ) from merge_rel_validation into master
2021-02-16 12:14:27 +01:00
Claudio Atzori
6f9864c564
manage merging of Relatation validation attributes
2021-02-16 11:53:44 +01:00
Alessia Bardi
32e81c2d89
non validated rel has null value in validated field
2021-02-16 11:01:42 +01:00
Antonis Lempesis
1c029b9fc0
fixed formatting
2021-02-14 03:14:24 +02:00
Miriam Baglioni
Claudio Atzori
Antonis Lempesis
Alessia Bardi