D-Net
/
dnet-hadoop
15
4
Fork 10
Code Issues 14 Pull Requests 8 Projects 2 Releases 1 Wiki Activity

Releases Tags

  • september-2023 77a2199837
    dhp-1.2.4
    dhp-1.2.3
    dhp-1.2.2
    dhp-1.2.1
    dhp-1.2.0
    dhp-1.1.7
    dhp-1.1.6
    dhp-1.1.5
    dhp-1.0.4
    dhp-1.0.3
    dhp-1.0.2
    1.0.1
    september-2023
    archive/master_pre_stable_ids
    archive/junit5
    archive/islookup_timeout
    archive/dedupTest
    archive/bipFinder_master_test
    ${ item.name }
    Create tag ${ searchTerm }
    Create branch ${ searchTerm }
    from 'master'
    ${ noResults }

    September 2023 Stable

    claudio.atzori released this 8 months ago | 383 commits to master since this release

    This release is based on 265180bfd2 and features the following changes:

    NEW!!!

    • #284 impact indicators workflow #8172
    • #320 Import affiliation relations from Crossref and relative fix #335

    Misc

    • #323 fixed various unit tests
    • #328 Add a "CleanRelation" action after the PropagateRelation to filter out all relations that have been deleted by inference or that are pointing to dangling entities

    Raw Graph creation

    • #336 datainfo.invisible set as true only for entities

    Deduplication workflow

    • #319 Import dnet-pace-core module in this project and use it after renaming to dhp-pace-core
    • #324 Refactor Dedup using Spark Dataframe API, initial support for scala 2.12 and Spark 3.4
    • #329 DispatchEntitiesSparkJob: manage all entity types together, support filtering by dataInfo.invisible flag
    • #330 Rewrite SparkPropagateRelation exploiting Dataframe API
    • #331 Add sparkExecutorMemoryOverhead workflow config to set off-heap memory for Spark actions. If not explicitly set it is defaulted to 1Gb

    Graph cleaning

    • #325 1st implementation of the suggestions from ticket #8898 for new cleaning criteria

    Graph indexing

    • #326 expand the instance level fulltext in the XML records

    Stats update workflow

    • #321, #322 [stats wf] Changes for promotion of production DBs to the new cluster
    Downloads