D-Net
/
dnet-hadoop
15
4
Fork 10
Code Issues 14 Pull Requests 8 Projects 2 Releases 1 Wiki Activity

WIP: Fix SWH integration WF #396

Draft
schatz wants to merge 1 commits from SWH_issue_377 into beta
pull from: SWH_issue_377
merge into: D-Net:beta
Conversation 3 Commits 1 Files Changed 7 +21 -126
schatz commented 2024-02-27 15:59:43 +01:00
Member
Copy Link
No description provided.
schatz added 1 commit 2024-02-27 15:59:44 +01:00
schatz commented 2024-02-27 16:02:58 +01:00
Author
Member
Copy Link

Related to: #377

Related to: https://code-repo.d4science.org/D-Net/dnet-hadoop/issues/377
claudio.atzori was assigned by schatz 2024-02-29 17:18:04 +01:00
schatz commented 2024-02-29 17:18:09 +01:00
Author
Member
Copy Link

@claudio.atzori @miriam.baglioni I made some additions in the job.properties files and removed the dependency to the graphInput path.

However in the last step of this WF, I get the following error:

Job aborted due to stage failure: Task 12 in stage 0.0 failed 4 times, most recent failure: Lost task 12.3 in stage 0.0 (TID 36, eos-m2-sn42.ocean.icm.edu.pl, executor 1): java.io.InvalidClassException: eu.dnetlib.dhp.schema.oaf.Result; local class incompatible: stream classdesc serialVersionUID = 5621923828687796800, local class serialVersionUID = -5414449622321221689

This WF, creates some Action Sets from scratch on that step. Any thoughts, why this might happen are more than welcome.
Please take a look also to the relevant Spark Job: http://iis-cdh5-test-gw.ocean.icm.edu.pl:18089/history/application_1676554762303_168005/2/jobs/job/?id=0

@claudio.atzori @miriam.baglioni I made some additions in the job.properties files and removed the dependency to the graphInput path. However in the last step of this WF, I get the following error: > > Job aborted due to stage failure: Task 12 in stage 0.0 failed 4 times, most recent failure: Lost task 12.3 in stage 0.0 (TID 36, eos-m2-sn42.ocean.icm.edu.pl, executor 1): java.io.InvalidClassException: eu.dnetlib.dhp.schema.oaf.Result; local class incompatible: stream classdesc serialVersionUID = 5621923828687796800, local class serialVersionUID = -5414449622321221689 This WF, creates some Action Sets from scratch on that step. Any thoughts, why this might happen are more than welcome. Please take a look also to the relevant Spark Job: http://iis-cdh5-test-gw.ocean.icm.edu.pl:18089/history/application_1676554762303_168005/2/jobs/job/?id=0
schatz commented 2024-04-01 16:07:28 +02:00
Author
Member
Copy Link

@claudio.atzori @miriam.baglioni Any ideas on this error?

@claudio.atzori @miriam.baglioni Any ideas on this error?
miriam.baglioni was assigned by schatz 2024-04-01 16:07:36 +02:00
This pull request is marked as a work in progress.
This branch is out-of-date with the base branch
You can also view command line instructions.

Step 1:

From your project repository, check out a new branch and test the changes.
git checkout -b SWH_issue_377 beta
git pull origin SWH_issue_377

Step 2:

Merge the changes and update on Gitea.
git checkout beta
git merge --no-ff SWH_issue_377
git push origin beta
Sign in to join this conversation.
Reviewers
No reviewers
Labels
Clear labels   
bug

Something is not working

  
duplicate

This issue or pull request already exists

  
enhancement

New feature / refactoring

  
help wanted

Need some help

  
invalid

Something is wrong

  
question

More information is needed

  
RDGraph

EOSC Research Discovery Graph

  
RSAC

EOSC Research Software APIs and Connectors

  
wontfix

This won't be fixed

No Label
bug
duplicate
enhancement
help wanted
invalid
question
RDGraph
RSAC
wontfix
Milestone
Clear milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
miriam.baglioni
claudio.atzori
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: D-Net/dnet-hadoop#396
No description provided.
Delete Branch "SWH_issue_377"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?