Commit Graph

2298 Commits (master)
 

Author SHA1 Message Date
miconis dcff9cecdf bug fix: ids in self mergerels are not marked deletedbyinference=true 3 years ago
Miriam Baglioni 70e391d427 merge upstream 3 years ago
Claudio Atzori 37b65cc3ad Merge pull request 'updates on stats-update workflow' (#100) from antonis.lempesis/dnet-hadoop:master into master
The workflow integrated in the _stable_ids_ branch has been run correctly on the BETA content, thus IMO this PR can be integrated in the master branch.

Reviewed-on: D-Net/dnet-hadoop#100
3 years ago
Miriam Baglioni 4b6e514f02 merge upstream 3 years ago
Antonis Lempesis 0ba0a6b9da update promote wf to support monitor&production 3 years ago
Antonis Lempesis 60ebdf2dbe update promote wf to support monitor&production 3 years ago
Antonis Lempesis 236435b470 following redirects 3 years ago
Antonis Lempesis 3c75a05044 fixed a ton of typos 3 years ago
Claudio Atzori 19f3580b3d introduced java8-based date parsing 3 years ago
Antonis Lempesis fa1ec5b5e9 fixed typo... 3 years ago
Antonis Lempesis f40c150a0d fixed steps... 3 years ago
Antonis Lempesis 6147ee4950 assigning correctly hive contexts to concepts 3 years ago
Antonis Lempesis c5fbad8093 Contexts are now downloaded instead of using the stats_ext db 3 years ago
Claudio Atzori e8789b0cdb Merge pull request 'stats DB for monitor' (#99) from antonis.lempesis/dnet-hadoop:master into master
Looks good to me, just a note on the parsing of the citations: since the last version, IIS produces citations as proper relationships among results. This is what we got already in the BETA graph

```
count		r.reltype	r.subreltype	r.relclass
62.129.254	resultResult	citation	cites
62.043.309	resultResult	citation	isCitedBy
```

Thus, I suggest to move away from the current property based implementation for the extraction of the citation links and start relying on the relationships instead.
3 years ago
Antonis Lempesis 27796343ca crude sleep. hardcoded value 3 years ago
Miriam Baglioni 896919e735 merge upstream 3 years ago
Antonis Lempesis d90767c733 correctly invalidating metadata 3 years ago
Antonis Lempesis 3681afbe04 typo 3 years ago
Antonis Lempesis c5502eba8f actually moved stats computation in impala instead of hive... 3 years ago
Antonis Lempesis 33c85d4e66 moved stats computation in impala instead of hive 3 years ago
Antonis Lempesis b8e96c8ae7 moved cache update to the end 3 years ago
Antonis Lempesis bcbfc052b1 fixed last errors in step 21 3 years ago
Antonis Lempesis 10a29a4b9a fixes in monitor step 3 years ago
Antonis Lempesis 8ef66452d5 fixed typo 3 years ago
Antonis Lempesis a8836e2f5f fixed typo 3 years ago
Antonis Lempesis a445c1ac3d fixed variable names in monitor script 3 years ago
Antonis Lempesis 00d516360f added missing ; 3 years ago
Antonis Lempesis cd1b794409 added the monitor db wf 3 years ago
Alessia Bardi bf2830b981 Merge pull request 'manage merging of Relatation validation attributes' (#95) from merge_rel_validation into master 3 years ago
Claudio Atzori 6f9864c564 manage merging of Relatation validation attributes 3 years ago
Alessia Bardi 32e81c2d89 non validated rel has null value in validated field 3 years ago
Antonis Lempesis 1c029b9fc0 fixed formatting 3 years ago
Antonis Lempesis 2c4dcc90ba analyzing tables to produce stats 3 years ago
Michele Artini 83d815d0bc only stats 3 years ago
Michele Artini 8c836bf930 Merge branch 'master' of code-repo.d4science.org:D-Net/dnet-hadoop 3 years ago
Michele Artini 8c1600398a added resumeFrom parameter 3 years ago
Claudio Atzori 3f8f78cbfb Merge branch 'master' of https://code-repo.d4science.org/D-Net/dnet-hadoop 3 years ago
Claudio Atzori b34b5a39ca index field authoridtypevalue mixes up different author id-type value pairs, dropped in favour of orcidtypevalue 3 years ago
Michele Artini 7249cceb53 switch of 2 nodes 3 years ago
Claudio Atzori 73393d3c4d Merge pull request 'validatedLinksToProjects' (#93) from validatedLinksToProjects into master
LGTM
3 years ago
Alessia Bardi 986dd969d3 use the proper import for Lists 3 years ago
Alessia Bardi c4d1feca74 mapper test with validated link to project 3 years ago
Alessia Bardi 09fc7e2f78 serialization of validated flag on relationships 3 years ago
Claudio Atzori bc458d1b54 Merge branch 'master' of https://code-repo.d4science.org/D-Net/dnet-hadoop 3 years ago
Claudio Atzori 82e6c50f3f updated solr fields (authoridtypevalue, resultsubject, resultresourcetypename) 3 years ago
Claudio Atzori 62bd3c53ee Merge branch 'master' into provision_indexing 3 years ago
Miriam Baglioni 2f5e6647c6 merge upstream 3 years ago
Alessia Bardi c67329d3ad updated test for EU Open Data portal datasets 3 years ago
Alessia Bardi fd705404a1 tests for EU Open Data portal dataset mapping 3 years ago
Miriam Baglioni 6190465851 merge upstream 3 years ago