D-Net
/
dnet-hadoop
13
4
Fork 10
Code Issues 14 Pull Requests 8 Projects 2 Releases 1 Wiki Activity

Adding the stats workflow to the dnet-hadoop hierarchy #6

Merged
claudio.atzori merged 1 commits from spyros/dnet-hadoop:master into master 2020-04-29 10:35:03 +02:00
Conversation 0 Commits 1 Files Changed 84 +1830
spyros commented 2020-04-03 19:30:13 +02:00
Contributor
Copy Link

In this PR we add the main part of the stats workflow to the dnet-hadoop. A few complementary steps (for specific chart tables & optimizations) could be added with another commit or PR.

The WF has been tested and runs to the end. The added statemets (steps of the WF) have been tested independently and they produce meaningful results.

In the workflow.xml 3 parameters have been defined:

  • stats_db_name : The name of the resulting database
  • openaire_db_name : The name of the input database that contains the OpenAIRE graph
  • external_stats_db_name : The database that contains external statistics needed for the construction of the statistics database and don't exist in the OpenAIRE graph
In this PR we add the main part of the stats workflow to the dnet-hadoop. A few complementary steps (for specific chart tables & optimizations) could be added with another commit or PR. The WF has been tested and runs to the end. The added statemets (steps of the WF) have been tested independently and they produce meaningful results. In the workflow.xml 3 parameters have been defined: - stats_db_name : The name of the resulting database - openaire_db_name : The name of the input database that contains the OpenAIRE graph - external_stats_db_name : The database that contains external statistics needed for the construction of the statistics database and don't exist in the OpenAIRE graph
claudio.atzori self-assigned this 2020-04-06 15:17:07 +02:00
claudio.atzori closed this pull request 2020-04-29 10:35:03 +02:00
Sign in to join this conversation.
Reviewers
No reviewers
Labels
Clear labels   
bug

Something is not working

  
duplicate

This issue or pull request already exists

  
enhancement

New feature / refactoring

  
help wanted

Need some help

  
invalid

Something is wrong

  
question

More information is needed

  
RDGraph

EOSC Research Discovery Graph

  
RSAC

EOSC Research Software APIs and Connectors

  
wontfix

This won't be fixed

No Label
bug
duplicate
enhancement
help wanted
invalid
question
RDGraph
RSAC
wontfix
Milestone
Clear milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
claudio.atzori
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: D-Net/dnet-hadoop#6
No description provided.
Delete Branch "spyros/dnet-hadoop:master"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?