65 Commits

Author	SHA1	Message	Date
Enrico Ottonello	08040cef80	spark action to analyze orcid lambda file	2020-05-12 16:57:43 +02:00
Sandro La Bruzzo	2b48a2c32c	Merge branch 'doiboost' of code-repo.d4science.org:D-Net/dnet-hadoop into doiboost	2020-05-11 09:38:36 +02:00
Sandro La Bruzzo	4cebca09d2	start implementing MAG mapping	2020-05-11 09:38:27 +02:00
Enrico Ottonello	9d812788e4	added job to download from orcid the records modified after a fixed date, the info are taken from last_modified.csv on hdfs	2020-05-08 14:49:39 +02:00
Enrico Ottonello	1edcd53581	added shell actions to download all 11 activities files from ORCID	2020-04-28 20:25:09 +02:00
Enrico Ottonello	a1861b9eaa	workflow works in parallel on 2 activity files	2020-04-24 18:33:37 +02:00
Enrico Ottonello	941e94af06	added workflow for generating authors with dois data sequence file	2020-04-24 15:50:40 +02:00
Sandro La Bruzzo	4ba386d996	improved crossref mapping	2020-04-23 09:33:48 +02:00
Enrico Ottonello	7d759947ae	used vtd for parsing orcid xml record, set 4g heapspace	2020-04-22 14:41:19 +02:00
Sandro La Bruzzo	5d46ec7d5f	fixed name of wrong package	2020-04-20 14:49:32 +02:00
Sandro La Bruzzo	82cc3b707d	fixed name of wrong package	2020-04-20 14:47:06 +02:00
Enrico Ottonello	4ae55e3891	added workflow parameters	2020-04-20 12:00:04 +02:00
Sandro La Bruzzo	eef60bb9f4	created structure of oozie wf for ORCID	2020-04-20 10:24:57 +02:00
Sandro La Bruzzo	618bc1fc72	first implementation of crossrefMapping	2020-04-20 09:53:34 +02:00
Sandro La Bruzzo	205e9521c6	implemented import crossref job	2020-04-01 14:12:33 +02:00