Commit Graph

42 Commits

Author SHA1 Message Date
Andrea Mannocci abfb626faa datasets updated. new dedup. new partitions 2022-02-16 15:27:26 +01:00
Miriam Baglioni 6c71bde5f8 OpenDaor, re3data and roar data updated 2022-02-14 13:23:50 +01:00
Andrea Mannocci 2df1b0ca2e new dump from fairsharing 2022-02-14 12:26:36 +01:00
Andrea Mannocci a8b52c6931 regenerating datasets with proper column names 2021-10-08 13:42:09 +02:00
Miriam Baglioni 8f3175f792 last updates 2021-10-07 11:19:40 +02:00
Miriam Baglioni 021c9b4db3 Merge branch 'master' of https://code-repo.d4science.org/andrea.mannocci/registries_analysis 2021-10-07 10:01:59 +02:00
Miriam Baglioni f8733ffc5f new OpenDOAR with missing field (sorry Andre) 2021-10-07 10:01:45 +02:00
Andrea Mannocci 9dfedb2a7b recreating dataframes 2021-10-07 09:37:21 +02:00
Andrea Mannocci da8f0818df Merge branch 'master' of https://code-repo.d4science.org/andrea.mannocci/data_registries_analysis 2021-10-07 09:36:12 +02:00
Miriam Baglioni 490b69833a new OpenDOAR with missing field 2021-10-07 09:32:45 +02:00
Andrea Mannocci 02e7ed79a2 recreating dataframes 2021-10-07 08:59:07 +02:00
Miriam Baglioni c0892c676c new mapping with dictionary to list the field name of wrapper elements also for OpenDOAR 2021-10-06 22:51:08 +02:00
Miriam Baglioni cae8426ef7 new mapping with dictionary to list the field name of wrapper elements 2021-10-06 18:04:01 +02:00
Miriam Baglioni 0fefbfd2c8 new mapping 2021-10-06 16:36:16 +02:00
Andrea Mannocci 264f527fcb partitioned dup groups 2021-10-04 13:46:28 +02:00
Andrea Mannocci 13f18b5d33 partitioned dup groups 2021-10-01 17:26:00 +02:00
miconis 84b32e5d33 addition of ds dedup with levenshtein distance and 0.9 threshold 2021-10-01 13:03:33 +02:00
Andrea Mannocci 76973593b6 removed old datasets 2021-10-01 12:05:35 +02:00
Andrea Mannocci b62be6dde8 downloaded FS again with metadata block 2021-10-01 12:00:03 +02:00
Andrea Mannocci c5411b0af0 downloaded FS again 2021-10-01 09:09:49 +02:00
Miriam Baglioni 10d08e4251 - 2021-09-30 12:46:55 +02:00
Miriam Baglioni 1c21796be8 - 2021-09-30 12:31:04 +02:00
Miriam Baglioni 56f871dc4d let's try again.... 2021-09-30 12:28:01 +02:00
Andrea Mannocci 7e3d933641 fixed re3data 2021-09-30 12:23:12 +02:00
Miriam Baglioni ca67c1c928 new version of .tsv 2021-09-30 12:16:35 +02:00
Andrea Mannocci b7226dfcc7 renaming fairsharing 2021-09-30 11:57:01 +02:00
Miriam Baglioni b94e693c57 Merge branch 'master' of https://code-repo.d4science.org/andrea.mannocci/registries_analysis 2021-09-30 11:55:43 +02:00
Miriam Baglioni c4c13fd6f2 Using values instad of None for empty fields 2021-09-30 11:54:56 +02:00
Andrea Mannocci 778882aa64 renaming re3data 2021-09-30 11:32:54 +02:00
Andrea Mannocci 93986fcec6 adding old opendoar dataset which was working fine 2021-09-30 11:31:24 +02:00
Andrea Mannocci faa8fd69cf adding raw fairsharing extended 2021-09-29 11:18:12 +02:00
Andrea Mannocci fffd8be0e0 adding raw fairsharing 2021-09-28 14:57:12 +02:00
Andrea Mannocci 52f10ca94b Merge branch 'master' of https://code-repo.d3science.org/andrea.mannocci/data_registries_analysis 2021-09-28 14:56:19 +02:00
Andrea Mannocci ecf5bd9ad7 addidng raw fairsharing 2021-09-28 14:56:12 +02:00
Miriam Baglioni 8d376a54f2 fixed openDoar.tsv 2021-09-24 11:47:33 +02:00
Miriam Baglioni 96fbaa553e new mapping from the last import in OpenAIRE 2021-09-23 14:49:25 +02:00
Andrea Mannocci 6abcd9b142 new dedup file 2021-09-22 11:59:30 +02:00
Andrea Mannocci 7ab83cbb10 starting to analyse overlap 2021-07-26 11:15:14 +02:00
Miriam Baglioni 434fe5ed20 Merge branch 'master' of https://code-repo.d4science.org/andrea.mannocci/registries_analysis 2021-07-23 14:18:21 +02:00
Andrea Mannocci be70e8cc74 added first dedup results 2021-07-23 12:38:56 +02:00
Miriam Baglioni 76ad6143ea added the mapping with hopefully nan values when empty elements in the xml 2021-07-22 13:10:02 +02:00
Andrea Mannocci c6d01322c3 added datasets 2021-07-22 11:03:05 +02:00