gCubeSystem
/
conductor-worker-python
16
0
Fork 0
Code Pull Requests Releases Activity
Custom python based workers for the Netflix OSS Conductor
73 Commits 2 Branches 0 Tags 102 KiB
Python 94.9%
Shell 3.2%
Dockerfile 1.9%
Go to file
dcore94 31399d110d moved to d4science hub 2024-03-08 16:27:27 +01:00
conductor remove to short readtimeout, improved security of calls by removing extra / and enforcing Cotnent-Type 2024-01-15 16:38:57 +01:00
docker use smaller image and perform update of packages 2024-01-15 16:40:49 +01:00
pollstrategies added strategies for polling 2024-03-08 16:25:55 +01:00
pyexecplugins removed wrong / 2024-02-14 20:21:38 +01:00
tests Added `tests` support and some implmentations test for `Http` plugin 2023-03-14 13:21:36 +01:00
.gitignore Worker now is resilient to connection's errors 2023-04-17 17:27:44 +02:00
Dockerfile major refactoring 2020-10-14 18:06:28 +02:00
PyExec.py Added significant logs at terminatio. Moved to strategies for polling 2024-03-08 16:25:28 +01:00
README.md major refactoring 2020-10-14 18:06:28 +02:00
build-base.sh new release 2020-10-30 19:19:31 +01:00
build-d4science.sh moved to d4science hub 2024-03-08 16:27:27 +01:00
build-provisioning.sh bug fixes 2020-11-05 15:27:58 +01:00
config-nw-docker-cluster.cfg example configs for provisioning workers of d4science ccp 2021-07-14 15:31:38 +02:00
config-nw-lxd-cluster.cfg example configs for provisioning workers of d4science ccp 2021-07-14 15:31:38 +02:00
config.cfg Default log level is `DEBUG` 2023-04-17 17:28:59 +02:00
entrypoint.sh adapted to 3.0.4 2021-05-12 15:47:15 +02:00
logging-docker.conf Default log level for docker is now set as `INFO` 2023-04-18 09:42:04 +02:00
logging.conf Default log level is `DEBUG` 2023-04-17 17:28:59 +02:00
mail-test-config.cfg added worker for sending emails and example configuration file 2021-03-22 11:28:05 +01:00
requirements.txt bumped requests to 2.28.2 and added ansible 2024-01-15 16:42:33 +01:00
setup.cfg First share 2020-06-19 10:50:02 +02:00
setup.py major refactoring 2020-10-14 18:06:28 +02:00
test.sh Added `test.sh` to perform tests, including requirmentes installation 2023-03-14 13:24:09 +01:00

README.md

Python workers for Conductor

Python worker for Conductor provides :

  1. PyExec: a plugin based set of workers for Netflix OSS Conductor written in Python3 for

Install

Example

python3 PyExec # Runs a bare PyExec supporting only Nop, Identity and Sequence plugins
python3 PyExec Http Ansible Packer #this runs PyExec with pyrest, pyansible and pypacker plugins enabled 
python3 PyExec Shell Eval # runs a a PyExec with only pyshell and py eval enabled. pyshell executes shell commands, pyeval executes arbitrary Python3 code