dedup_new_comparators #509

michele.debonis · 2024-11-18T15:07:20+01:00

michele.debonis commented

2024-11-18 15:07:20 +01:00

This PR implements a new comparator for the decision tree dedup. Its name is DateRange and it is able to derive if two dates are in a certain year range. Moreover, it implements a new specialization for the JsonListMatch comparator, useful to consider the type of the PID in an exclusive way.
It works as follow:

it checks for the PID types of both lists
when no common types are found, the comparator returns 'undefined' because it is impossible to compare
when common types are found, the two lists are compared using only PIDs with the same type

This PR implements a new comparator for the decision tree dedup. Its name is DateRange and it is able to derive if two dates are in a certain year range. Moreover, it implements a new specialization for the JsonListMatch comparator, useful to consider the type of the PID in an exclusive way. It works as follow: - it checks for the PID types of both lists - when no common types are found, the comparator returns 'undefined' because it is impossible to compare - when common types are found, the two lists are compared using only PIDs with the same type

michele.debonis added 5 commits 2024-11-18 15:07:21 +01:00

62c4c3ed29 implementation of new comparators for organization and dataset disambiguation

5015ba10eb addition of date comparator

eab623ddfa implementation of date matcher

6c17993d16 Merge branch 'beta' into dedup_new_comparators

c97facf5e6 conflict resolution in the comparator test class

claudio.atzori merged commit ef51a60f19 into beta

2024-11-19 15:13:41 +01:00

claudio.atzori referenced this issue from a commit

2024-11-19 15:13:42 +01:00

Merge pull request 'dedup_new_comparators' (#509) from dedup_new_comparators into beta

Sign in to join this conversation.