Commit Graph

Select branches

Hide Pull Requests

airflow

develop

master

oct-update

#1

#2

Mono Color

• 113a662ba8 Load Airflow dags from local folder develop Giambattista Bloisi 2024-11-23 21:03:27 +0100
• 7d353702d1 Revised documentation Giambattista Bloisi 2024-11-23 21:02:53 +0100
• e1ef2438e1 added spark-cloud dependency for the committer sandro.labruzzo 2024-11-19 11:52:44 +0100
• 8bbbbf51ae added committer to configuration sandro.labruzzo 2024-11-19 09:59:20 +0100
• 9682e964b3 fixed workflow parameters sandro.labruzzo 2024-11-18 16:42:16 +0100
• 4372ab9e1c fixed import sandro.labruzzo 2024-11-18 16:34:07 +0100
• 961c24afcc fixed import sandro.labruzzo 2024-11-18 16:30:16 +0100
• 9da33a9f00 removed test workflow sandro.labruzzo 2024-11-18 16:29:09 +0100
• 6e396f7e34 added resource profiles sandro.labruzzo 2024-11-18 16:19:55 +0100
• 9ae7152afb added scholexplorer workflow sandro.labruzzo 2024-11-18 15:23:34 +0100
• 30f2b345d6 added scholexplorer workflow sandro.labruzzo 2024-11-18 15:23:17 +0100
• 52376a3416 Merge pull request 'updated documentation' (#2) from oct-update into master master Sandro La Bruzzo 2024-11-18 10:52:51 +0100
• c9bcc36f43 updated documentation #2 oct-update sandro.labruzzo 2024-11-18 10:52:02 +0100
• 3e5781e52e Merge pull request 'oct-update' (#1) from oct-update into master Sandro La Bruzzo 2024-11-18 10:43:07 +0100
• 9e69ded5ef Copy relations in ORCID enrichment DAG #1 Giambattista Bloisi 2024-11-06 16:07:34 +0100
• 13ac9767c6 Orcid propagation step Giambattista Bloisi 2024-11-06 15:18:17 +0100
• ac2fbbb9f9 Add jupyterhub Giambattista Bloisi 2024-11-06 14:04:33 +0100
• c0788fcd10 Add resolvereletion step Giambattista Bloisi 2024-10-29 14:49:26 +0100
• 004be2e97f Add resolvereletion step Giambattista Bloisi 2024-10-29 14:39:01 +0100
• 9058dbb957 Clean DAG Giambattista Bloisi 2024-10-28 21:12:23 +0100
• b01331d4d0 Clean DAG Giambattista Bloisi 2024-10-28 21:11:33 +0100
• 7af06fbda5 Clean DAG Giambattista Bloisi 2024-10-28 21:10:38 +0100
• 6c25db9ac2 Clean DAG Giambattista Bloisi 2024-10-28 21:04:17 +0100
• b3d7dda0c1 DAG to build the graph from a delta Giambattista Bloisi 2024-10-28 17:04:44 +0100
• e64b3ec6b1 removed test dir Sandro La Bruzzo 2024-10-23 08:37:01 +0200
• e92ef9fbcb enable ingressUrlFormat Giambattista Bloisi 2024-10-22 21:31:48 +0200
• 1bd836b88a Provide paths as dag configuration parameters Giambattista Bloisi 2024-10-22 10:19:40 +0200
• 15ba3cf202 Provide paths as dag configuration parameters Giambattista Bloisi 2024-10-22 10:16:32 +0200
• 73e78d6877 Add workflow with all graph construction steps Giambattista Bloisi 2024-10-21 21:31:43 +0200
• aae37058f7 Increase memory Giambattista Bloisi 2024-10-21 20:30:31 +0200
• 131f6e5592 enable dynamic allocation Giambattista Bloisi 2024-10-21 20:23:31 +0200
• df46c8c65f Added ORCID enrichment workflows Giambattista Bloisi 2024-10-21 18:49:21 +0200
• 034a01542a Implement consistency workflow Giambattista Bloisi 2024-10-21 15:25:48 +0200
• c6fbfd3f0a Remove numpartitions argument where not needed Giambattista Bloisi 2024-10-21 14:30:40 +0200
• ae89274ce4 implemente whole scan pipeline Giambattista Bloisi 2024-10-21 14:10:28 +0200
• fa90a9dbe0 Update spark operator version Giambattista Bloisi 2024-10-21 09:36:55 +0200
• 0a2956d81f reduce executor cores Giambattista Bloisi 2024-10-19 17:55:53 +0200
• 48f688cda9 add deps jar Giambattista Bloisi 2024-10-19 11:13:21 +0200
• c5f4263061 update spark-version Giambattista Bloisi 2024-10-19 11:09:24 +0200
• ba3f351736 print existing files Giambattista Bloisi 2024-10-19 10:15:30 +0200
• 448bb924ab add test dedup task Giambattista Bloisi 2024-10-18 22:51:17 +0200
• bf7c9e2dce revert some changes Giambattista Bloisi 2024-10-18 17:16:37 +0200
• 8da265f018 add utils in the parent folder Giambattista Bloisi 2024-10-18 17:00:51 +0200
• 0fcabed2ae change dag name Giambattista Bloisi 2024-10-18 16:58:42 +0200
• c3ba29e4c5 Add dagutils Giambattista Bloisi 2024-10-18 16:53:14 +0200
• 412e008df7 Add untar task Giambattista Bloisi 2024-10-18 16:42:54 +0200
• df6e23666e fix Sandro La Bruzzo 2024-10-16 16:35:01 +0200
• d1afcd4395 fixed import Sandro La Bruzzo 2024-10-16 14:08:00 +0200
• dcd2efd3b4 added workflow test Sandro La Bruzzo 2024-10-16 13:56:50 +0200
• 6b555b8f6e added workflow test Sandro La Bruzzo 2024-10-16 13:56:36 +0200
• b8bf21f8e5 fixed import Sandro La Bruzzo 2024-10-16 13:51:49 +0200
• 07ce192207 added workflow test Sandro La Bruzzo 2024-10-16 13:38:26 +0200
• ed3422673f added git variable for airflow module Sandro La Bruzzo 2024-10-16 13:35:49 +0200
• 35c44845d2 added creation of bucket using variables Sandro La Bruzzo 2024-10-16 12:07:14 +0200
• 85cf6eeb1a fixed bucket creation updated tenant yaml Sandro La Bruzzo 2024-10-16 10:45:48 +0200
• 7528675590 update version of minio Giambattista Bloisi 2024-10-16 09:08:14 +0200
• 02a15472d4 Update README.md Claudio Atzori 2024-05-16 12:30:38 +0200
• 8c8862be36 Update README.md Claudio Atzori 2024-05-16 12:30:04 +0200
• 935705caaf code formatted airflow Sandro La Bruzzo 2024-05-02 16:22:54 +0200
• 372da136df minor fix Sandro La Bruzzo 2024-05-02 14:54:17 +0200
• 7eb5e35753 minor fix Sandro La Bruzzo 2024-05-02 14:51:45 +0200
• cb06d46bb2 minor fix Sandro La Bruzzo 2024-05-02 14:50:25 +0200
• 3666871e4d minor fix Sandro La Bruzzo 2024-05-02 14:23:45 +0200
• ef104b10e6 minor fix Sandro La Bruzzo 2024-05-02 13:58:28 +0200
• c5ceaeb12b minor fix Sandro La Bruzzo 2024-05-02 13:54:14 +0200
• 4cd6852ad9 minor fix Sandro La Bruzzo 2024-05-02 13:53:57 +0200
• 5f4316bfd0 minor fix Sandro La Bruzzo 2024-05-02 11:55:02 +0200
• 8dff6727ef minor fix Sandro La Bruzzo 2024-05-02 11:51:56 +0200
• c37a84bb89 minor fix Sandro La Bruzzo 2024-05-02 11:34:32 +0200
• c9c80ad9b9 updated airflow roles Sandro La Bruzzo 2024-05-02 11:31:17 +0200
• 5a9cffbe3a updated airflow dag Sandro La Bruzzo 2024-05-02 11:22:27 +0200
• 730f35fb75 added airflow dag Sandro La Bruzzo 2024-05-02 11:05:59 +0200
• 7dda6d9be7 added airflow dag Sandro La Bruzzo 2024-05-02 11:05:22 +0200
• 196ba0b54a removed depenedency to costum spark-operator Sandro La Bruzzo 2024-05-02 10:33:21 +0200
• 32e8e86aa7 added spark driver image Sandro La Bruzzo 2024-05-01 16:35:21 +0200
• 0863c9b2e9 Added airflow to modules Sandro La Bruzzo 2024-04-22 12:29:21 +0200
• 090d9ba87c added standard folder dag for airflow Sandro La Bruzzo 2024-04-22 11:54:48 +0200
• 7a8a2e6285 - Update spark-operator version and image to support s3 - Change default code repo for Dag airflow to this repository, branch airflow, folder "airflow/dags" Giambattista Bloisi 2024-04-22 10:20:20 +0200
• 9631d0245b Improved documentation Sandro La Bruzzo 2024-04-19 16:32:51 +0200
• b51fd066e4 added setup for generating cluster with minio Sandro La Bruzzo 2024-04-19 15:54:18 +0200
• cb1f95d82a added setup for generating cluster with minio Sandro La Bruzzo 2024-04-19 15:53:45 +0200
• eb18526071 added ignore terraform Sandro La Bruzzo 2024-04-19 15:32:07 +0200
• e03ec0c27d first import Sandro La Bruzzo 2024-04-19 15:25:44 +0200
• ca3ce0cdcc first commit Sandro La Bruzzo 2024-04-16 13:48:46 +0200