Cleaning of PIDs #490

claudio.atzori · 2024-10-08T15:06:20+02:00

claudio.atzori commented

2024-10-08 15:06:20 +02:00

This PR makes the utility class eu.dnetlib.dhp.schema.oaf.utils.PidCleaner used across the pipeline. Replacing the usages of the utility methods that used to be defined within eu.dnetlib.dhp.schema.oaf.utils.CleaningFunctions.
It also adjusts the tests in dhp-common and in dhp-graph-mapper.

Furthermore, it restores the removal of duplicated PIDs, already implemented which silently stopped working when the internal model classes did not expose the hashCode and the equals methods.

This PR makes the utility class `eu.dnetlib.dhp.schema.oaf.utils.PidCleaner` used across the pipeline. Replacing the usages of the utility methods that used to be defined within `eu.dnetlib.dhp.schema.oaf.utils.CleaningFunctions`. It also adjusts the tests in `dhp-common` and in `dhp-graph-mapper`. Furthermore, it restores the removal of duplicated PIDs, already implemented which silently stopped working when the internal model classes did not expose the `hashCode` and the `equals` methods.

claudio.atzori added 1 commit 2024-10-08 15:06:21 +02:00

c4e8aaca1f PidCleaner used pervasively

claudio.atzori merged commit a50e04154e into main

2024-10-08 15:08:13 +02:00

claudio.atzori referenced this issue from a commit

2024-10-08 15:08:15 +02:00

Merge pull request 'PidCleaner used pervasively' (#490) from pid_cleaning into main

claudio.atzori referenced this issue from a commit

2024-10-08 15:40:04 +02:00

merged #490

claudio.atzori commented

2024-10-08 15:41:03 +02:00