14 Commits

Author	SHA1	Message	Date
dimitrispie	a94a54a2d0	Changes for tables and creation of the new indicator indi_is_result_accessible ... - Drop table statements for all tables to avoid duplicates in case of wf rerun - Add pdfsaggregated step to create the indi_is_result_accessible table. This step is executed on the new impala cluster only, since the pdfaggregation_i is updated on this cluster.	2023-11-15 14:32:18 +02:00
Antonis Lempesis	7112806a73	views cannot be stored as parquet...	2022-03-29 16:37:29 +03:00
Antonis Lempesis	ee24f3eb2c	views cannot be stored as parquet...	2022-03-29 13:47:48 +03:00
Antonis Lempesis	62f91b0869	cleanup	2022-03-22 16:17:49 +02:00
Antonis Lempesis	2e8394ecf8	creating aaall tables as parquet	2022-03-22 16:16:08 +02:00
Antonis Lempesis	dbd2646d59	fixed the result_result creation for monitor	2022-02-03 12:37:10 +02:00
Antonis Lempesis	33c85d4e66	moved stats computation in impala instead of hive	2021-02-18 17:23:34 +02:00
Antonis Lempesis	1c029b9fc0	fixed formatting	2021-02-14 03:14:24 +02:00
Antonis Lempesis	2c4dcc90ba	analyzing tables to produce stats	2021-02-14 02:54:55 +02:00
Antonis Lempesis	e6f50de6ef	Separated impala from hive steps	2020-07-24 19:50:40 +03:00
Spyros Zoupanos	5546f29e63	Corrections on the shadow schema and the impala table stats calculation	2020-07-24 19:50:40 +03:00
Spyros Zoupanos	adf8a025d2	Adding more relations (Sources, Licences, Additional) and shadow schema as provided and discussed with Antonis Lempesis	2020-07-24 19:50:40 +03:00
Spyros Zoupanos	657a40536b	Corrections by Spyros: Scipt cleanup, corrections and re-arrangement	2020-07-24 19:50:40 +03:00
Giorgos Alexiou	477fa6234d	Script re-organisation and adding table invalidations needed for impala	2020-07-24 19:50:40 +03:00