Commit Graph

297 Commits (beta)

Author SHA1 Message Date
Andreas Czerniak 2d0a4d5b85 refine of rateLimit, add fileGZip,dris2db.xsl 2 years ago
Miriam Baglioni 42e8f76778 [GraphCleaning] change the return value in the filtering function to avoid to lose the APC entities 2 years ago
Claudio Atzori 4f212652ca scalafmt: code formatting 2 years ago
Miriam Baglioni be0acccf42 Merge branch 'beta' into dump 2 years ago
Sandro La Bruzzo 3920d68992 Fixed workflow generation of delta in datacite 2 years ago
Sandro La Bruzzo b881ee5ef8 [scholexplorer]
- implemented generation of scholix of delta update of datacite
2 years ago
Miriam Baglioni 56409d1281 [Dump] resolved conflicts with beta and merging 2 years ago
Miriam Baglioni a3592b463a Merge branch 'beta' of https://code-repo.d4science.org/D-Net/dnet-hadoop into beta 2 years ago
Claudio Atzori aff3ddc8d2 added cleaning for the format field, removing carrige return and tab characters 2 years ago
Miriam Baglioni 936578aaf1 Merge branch 'beta' of https://code-repo.d4science.org/D-Net/dnet-hadoop into beta 2 years ago
Claudio Atzori 41c70c607d cleaning workflow assigns the proper default instance type when a value could not be cleaned using the vocabularies 2 years ago
Claudio Atzori e6e177dda0 vocabulary based cleaning considers also the term label when looking up for a synonym 2 years ago
Miriam Baglioni b113586207 resolved conflicts 2 years ago
Sandro La Bruzzo 5d51b3dd4a Merge pull request 'scala_refactor' (#169) from scala_refactor into beta
Reviewed-on: D-Net/dnet-hadoop#169
2 years ago
Miriam Baglioni 96a7d46278 [Graph Dump] fixed tests 2 years ago
Sandro La Bruzzo 81bf604059 [scala-refactor] Module dhp-common:
Moved all scala source into src/main/scala and src/test/scala
2 years ago
Claudio Atzori 9132727793 fixed date cleaning test 2 years ago
Claudio Atzori 863a2f9db3 avoid to filter OAF records defined as invisible = true 2 years ago
Miriam Baglioni 8905a39bf3 mergin with branch beta 2 years ago
Sandro La Bruzzo 1e1f5e4fe0 minor fix 2 years ago
Sandro La Bruzzo 2164a2a889 Datacite: Code Refactor generated a general SparkApplication Scala where all the spark scala have to inherit
Commented a little the Datacite transformation code
2 years ago
Sandro La Bruzzo 4542a2338b updated site configuration to deploy on website 2 years ago
Miriam Baglioni 9fae872181 [Graph Dump] changed to mirror the changes in the model 2 years ago
Claudio Atzori 62fa61f3cf merge from beta 2 years ago
Claudio Atzori bd9a43cefd Revert to 4094f2bb9a 2 years ago
Claudio Atzori 82a4e4efae [cleaning wf] fixed methodology to rule out invalid result titles, based on https://support.openaire.eu/issues/7206 2 years ago
Sandro La Bruzzo 60ae874dcb Merge branch 'beta' of code-repo.d4science.org:D-Net/dnet-hadoop into mvn_site_documentation 2 years ago
Claudio Atzori 49f897ef29 [cleaning wf] fixed regex used to spot garbage in result titles; adjusted threshold for filtering titles 2 years ago
Sandro La Bruzzo a1cafaf2e3 added mvn site for dnet-hadoop project 2 years ago
Sandro La Bruzzo aafdffa6b3 resolved conflict 3 years ago
Sandro La Bruzzo 034304b33a conflict resolved on merge 3 years ago
Claudio Atzori 6b34ba737e minor 3 years ago
Sandro La Bruzzo ae4e99a471 Adapted workflow of resolution of PID to work into OpenAIRE data workflow
- Added relations in both verse on all Scholexplorer datasources
3 years ago
Miriam Baglioni c8321ad31a merge with branch beta 3 years ago
Claudio Atzori 663b1556d7 manually integrating PR#140 D-Net/dnet-hadoop#140 3 years ago
Claudio Atzori baed5e3337 test classes moved in specific components 3 years ago
Claudio Atzori 3359f73fcf cleanup & best practices 3 years ago
Miriam Baglioni 58f241f4a2 GetCSV refactoring - changed due to change of input resource 3 years ago
Miriam Baglioni f3d575f749 GetCSV refactoring - changed due to changes in input resource 3 years ago
Miriam Baglioni a5f6edfa6c GetCSV refactoring - changed to mirror the original model class 3 years ago
Miriam Baglioni 7402daf51a GetCSV refactoring - added dependency to open-csv lib 3 years ago
Miriam Baglioni 733bcaecf6 GetCSV refactoring - added test class (all the tests are disabled since they refer to remote resource) 3 years ago
Miriam Baglioni bfe8f5335c GetCSV refactoring - copied model classes in test path 3 years ago
Miriam Baglioni 6e84b3951f GetCSV refactoring - moving classes to dhp-common that have dependency with GetCSV class (that was located in graph-mapper) 3 years ago
Miriam Baglioni 9650eea497 reverting 3 years ago
Miriam Baglioni cc3d72df0e removing not needed dependency 3 years ago
Miriam Baglioni f9b6b45d85 reverting 3 years ago
Miriam Baglioni 8da3a25cf6 merging with branch beta 3 years ago
Claudio Atzori 2ee21da43b suggestions from SonarLint 3 years ago
Miriam Baglioni 6bd1eca7e0 merge branch with beta 3 years ago