D-Net
/
dnet-hadoop
13
4
Fork 10
Code Issues 14 Pull Requests 7 Projects 2 Releases 1 Wiki Activity

removed the repartition(1). Added code for the creation of an archive containing all the parts dumped for each community

This commit is contained in:
Miriam Baglioni 2020-08-11 11:18:58 +02:00
parent 1991a49f70
commit 341dc59ead
1 changed files with 0 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
dhp-workflows/dhp-graph-mapper/src/main/java/eu/dnetlib/dhp/oa/graph/dump/community/CommunitySplit.java
View File

@ -59,7 +59,6 @@ public class CommunitySplit implements Serializable {
try { try {
community_products.first(); community_products.first();
community_products community_products
.repartition(1)
.write() .write()
.option("compression", "gzip") .option("compression", "gzip")
.mode(SaveMode.Overwrite) .mode(SaveMode.Overwrite)