beta #189

Closed
andreas.czerniak wants to merge 9 commits from andreas.czerniak/BrBETA_dnet-hadoop:beta into beta

After a period without merging the upstream and working on the fork, here are some inputs regarding:

  • xml exmaple records
  • xslt's
  • refine of rate-limit
  • adopting the fileGZip collector to Hadoop

and the merge, of course.

After a period without merging the upstream and working on the fork, here are some inputs regarding: * xml exmaple records * xslt's * refine of rate-limit * adopting the fileGZip collector to Hadoop and the merge, of course.
andreas.czerniak added 9 commits 2022-01-26 10:51:07 +01:00
andreas.czerniak requested review from claudio.atzori 2022-01-26 10:51:19 +01:00

This PR requires more work before it can be integrated. At first glance the fileGZip collector class looks ok, we miss the changes needed in the eu.dnetlib.dhp.collection.CollectorWorker to select it in response to the parameters passed by the orchestration system.

This PR requires more work before it can be integrated. At first glance the fileGZip collector class looks ok, we miss the changes needed in the ```eu.dnetlib.dhp.collection.CollectorWorker``` to select it in response to the parameters passed by the orchestration system.
claudio.atzori closed this pull request 2023-11-22 14:14:38 +01:00

Pull request closed

Sign in to join this conversation.
No reviewers
No Milestone
No project
No Assignees
2 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: D-Net/dnet-hadoop#189
No description provided.