dnet-hadoop/dhp-workflows/dhp-stats-update/src
Lampros Smyrnaios d46b78b659 dhp-stats-update:
- Set Steps 2-7 and 9 to limit the amount of files generated by Spark, from 8000, down to 100, to improve file-transfer and querying performance.
- Allow the workflow to run up to Step10. The Step11 seems to have some issues even when using hive-action.
2024-04-18 15:40:27 +03:00
..
main/resources/eu/dnetlib/dhp/oa/graph/stats/oozie_app dhp-stats-update: 2024-04-18 15:40:27 +03:00