D-Net
/
dnet-hadoop
13
4
Fork 10
Code Issues 14 Pull Requests 8 Projects 2 Releases 1 Wiki Activity

Continuous Validation Workflow #388

Open
lsmyrnaios wants to merge 18 commits from lsmyrnaios/dnet-hadoop:continuous_validation2 into beta
pull from: lsmyrnaios/dnet-hadoop:continuous_validation2
merge into: D-Net:beta
Conversation 0 Commits 18 Files Changed 14 +522 -12

18 Commits

Author SHA1 Message Date
Lampros Smyrnaios aaa7d3cf86 Merge remote-tracking branch 'main/beta' into continuous_validation2 2024-02-05 11:57:45 +02:00
Lampros Smyrnaios cbe7c6734a - Add documentation. 
- Code polishing/cleanup.
 2024-02-02 14:18:46 +02:00
Lampros Smyrnaios b5f4d37827 Merge branch 'beta' of https://code-repo.d4science.org/lsmyrnaios/dnet-hadoop into continuous_validation2 2024-01-31 13:01:42 +02:00
Lampros Smyrnaios 8d0ed7d414 Continuous-Validation updates: 
- Update the "uoa-validator-engine2" dependency.
- Update the "installProject.sh" script to account for potential conflict with previous builds.
- Add documentation.
 2024-01-25 18:23:14 +02:00
Lampros Smyrnaios eee085c104 Force a check for updated releases and snapshots on remote repositories, when building the Continuous-Validation workflow. 2024-01-24 14:08:32 +02:00
Lampros Smyrnaios ff47a941f5 - Add the "installProject.sh" script. 
- Show the Job-ID or potential deployment-error-logs, right after the deployment of the workflow.
- Code polishing.
 2024-01-18 18:06:50 +02:00
Lampros Smyrnaios 00644ef487 - Fix the "NoSuchFieldError", caused by library-conflicts, by introducing the "oozie.libpath" property in "workflow.xml". 
- Fix the value of the "outputPath" property, in "workflow.xml".
 2024-01-18 15:46:27 +02:00
Lampros Smyrnaios 23ec57c670 Merge branch 'beta' of https://code-repo.d4science.org/D-Net/dnet-hadoop into continuous_validation2 2024-01-17 18:16:11 +02:00
Lampros Smyrnaios c17834dddf - Use "KryoSerializer" for Spark and register some "result" classes. 
- Code polishing and cleanup.
 2024-01-17 18:08:05 +02:00
Lampros Smyrnaios 32e02247bc Merge branch 'continuous_validation2' of https://code-repo.d4science.org/lsmyrnaios/dnet-hadoop into continuous_validation2 2024-01-09 17:05:07 +02:00
Lampros Smyrnaios eaa070f1e6 Code cleanup. 2024-01-09 17:03:35 +02:00
Claudio Atzori fc35b44e22 bumped version of uoa-validator-engine2 to 0.9.3 2024-01-09 15:56:56 +01:00
Lampros Smyrnaios 17282ea8fc - Fix the "is not NULL" checks inside "spark.filter()" 
- Make sure the "outputPath" ends with a "/", in any case.
- Fix a parameter-description.
 2023-12-20 15:15:56 +02:00
Claudio Atzori 22fa60c3dd removed lib biinary 2023-12-18 15:50:29 +01:00
Claudio Atzori 24173d7a0b continuous validation WIP 2023-12-18 15:46:36 +01:00
Lampros Smyrnaios a2feda6c07 - Fix acquiring the "openaire_guidelines" parameter. 
- Use the right Guidelines-profile, depending on the "openaire_guidelines" version.
- Update log-levels.
- Optimize imports.
 2023-12-18 10:57:40 +02:00
Lampros Smyrnaios b71633fd7f - Fix the location of the "input_continuous_validator_parameters.json" file. 
- Fix handing the "isSparkSessionManaged" parameter.
- Add the "provided" scope for some dependencies. They do not inherit it from the main pom, since the "version" tag is declared, even though the value is the same as the one from the main pom.
- Code polishing / cleanup.
 2023-12-15 18:29:38 +02:00
Lampros Smyrnaios 9e6a03e4e2 Initial commit of the "dhp-continuous-validation" module. 2023-12-15 15:53:31 +02:00