2021-11-15 14:32:01 +01:00
|
|
|
##DHP-Aggregation
|
|
|
|
|
|
2021-11-16 17:41:34 +01:00
|
|
|
This module defines a set of oozie workflows for
|
2021-11-15 14:32:01 +01:00
|
|
|
|
2021-11-16 17:41:34 +01:00
|
|
|
1. the **collection** and **transformation** of metadata records.
|
|
|
|
|
2. the **integration** of new external information in the result
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
### Collection and Transformation
|
|
|
|
|
|
|
|
|
|
The workflows interact with the Metadata Store Manager (MdSM) to handle the logical transactions required to ensure
|
2021-11-15 14:32:01 +01:00
|
|
|
the consistency of the read/write operations on the data as the MdSM in fact keeps track of the logical-physical mapping
|
|
|
|
|
of each MDStore.
|
|
|
|
|
|
2021-11-16 17:41:34 +01:00
|
|
|
It defines [mappings](mappings.md) for transformation of different datasource (See mapping section).
|
|
|
|
|
|
|
|
|
|
### Integration of external information in the result
|
|
|
|
|
|
|
|
|
|
The workflows create new entity in the OpenAIRE format (OAF) which aim is to enrich the result already contained in the graph.
|
|
|
|
|
See integration section for more insight
|
