D-Net
/
dnet-hadoop
14
5
Fork 11
Code Issues 14 Pull Requests 10 Projects 2 Releases 2 Wiki Activity

removed the repartition(1). Added code for the creation of an archive containing all the parts dumped for each community

This commit is contained in:
Miriam Baglioni 2020-08-11 11:18:58 +02:00
parent 1991a49f70
commit 341dc59ead
1 changed files with 0 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
dhp-workflows/dhp-graph-mapper/src/main/java/eu/dnetlib/dhp/oa/graph/dump/community/CommunitySplit.java
View File

@ -59,7 +59,6 @@ public class CommunitySplit implements Serializable {
try {
community_products.first();
community_products
.repartition(1)
.write()
.option("compression", "gzip")
.mode(SaveMode.Overwrite)