Lampros Smyrnaios
c17834dddf
- Use "KryoSerializer" for Spark and register some "result" classes.
...
- Code polishing and cleanup.
2024-01-17 18:08:05 +02:00
Lampros Smyrnaios
eaa070f1e6
Code cleanup.
2024-01-09 17:03:35 +02:00
Lampros Smyrnaios
17282ea8fc
- Fix the "is not NULL" checks inside "spark.filter()"
...
- Make sure the "outputPath" ends with a "/", in any case.
- Fix a parameter-description.
2023-12-20 15:15:56 +02:00
Claudio Atzori
24173d7a0b
continuous validation WIP
2023-12-18 15:46:36 +01:00
Lampros Smyrnaios
a2feda6c07
- Fix acquiring the "openaire_guidelines" parameter.
...
- Use the right Guidelines-profile, depending on the "openaire_guidelines" version.
- Update log-levels.
- Optimize imports.
2023-12-18 10:57:40 +02:00
Lampros Smyrnaios
b71633fd7f
- Fix the location of the "input_continuous_validator_parameters.json" file.
...
- Fix handing the "isSparkSessionManaged" parameter.
- Add the "provided" scope for some dependencies. They do not inherit it from the main pom, since the "version" tag is declared, even though the value is the same as the one from the main pom.
- Code polishing / cleanup.
2023-12-15 18:29:38 +02:00
Lampros Smyrnaios
9e6a03e4e2
Initial commit of the "dhp-continuous-validation" module.
2023-12-15 15:53:31 +02:00
Lampros Smyrnaios
Claudio Atzori