andreas.czerniak
/
BrBETA_dnet-hadoop
forked from D-Net/dnet-hadoop
1
1
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

removed the repartition(1). Added code for the creation of an archive containing all the parts dumped for each community

This commit is contained in:
Miriam Baglioni 2020-08-11 11:18:58 +02:00
parent 1991a49f70
commit 341dc59ead
1 changed files with 0 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
dhp-workflows/dhp-graph-mapper/src/main/java/eu/dnetlib/dhp/oa/graph/dump/community/CommunitySplit.java
View File

@ -59,7 +59,6 @@ public class CommunitySplit implements Serializable {
try { try {
community_products.first(); community_products.first();
community_products community_products
.repartition(1)
.write() .write()
.option("compression", "gzip") .option("compression", "gzip")
.mode(SaveMode.Overwrite) .mode(SaveMode.Overwrite)