D-Net
/
dnet-hadoop
14
5
Fork 11
Code Issues 14 Pull Requests 13 Projects 2 Releases 2 Wiki Activity

[SDG-FOS] to import SDG file not considering the header #182

Merged
miriam.baglioni merged 1 commits from SDG into beta 2022-01-07 16:28:55 +01:00
Conversation 0 Commits 1 Files Changed 1 +2
1 changed files with 2 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
dhp-workflows/dhp-aggregation/src/main/java/eu/dnetlib/dhp/actionmanager/createunresolvedentities/GetSDGSparkJob.java
View File

@ -69,6 +69,8 @@ public class GetSDGSparkJob implements Serializable {
.read() .read()
.format("csv") .format("csv")
.option("sep", delimiter) .option("sep", delimiter)
.option("inferSchema", "true")
.option("header", "true")
.option("quotes", "\"") .option("quotes", "\"")
.load(sourcePath); .load(sourcePath);