Custom python based workers for the Netflix OSS Conductor
Go to file
dcore94 b7a41a0f36 removed obsolete Dockerfile 2024-03-08 17:16:46 +01:00
conductor fixed wrong variable naming 2024-03-08 16:44:42 +01:00
docker/d4science removed obsolete code 2024-03-08 16:48:51 +01:00
pollstrategies added strategies for polling 2024-03-08 16:25:55 +01:00
pyexecplugins add a response timeout to HTTP task in order to avoid starvation 2024-03-08 16:35:03 +01:00
tests Added `tests` support and some implmentations test for `Http` plugin 2023-03-14 13:21:36 +01:00
.gitignore Worker now is resilient to connection's errors 2023-04-17 17:27:44 +02:00
PyExec.py Added significant logs at terminatio. Moved to strategies for polling 2024-03-08 16:25:28 +01:00
README.md major refactoring 2020-10-14 18:06:28 +02:00
build-d4science.sh moved to d4science hub 2024-03-08 16:27:27 +01:00
config-nw-lxd-cluster.cfg example configs for provisioning workers of d4science ccp 2021-07-14 15:31:38 +02:00
config.cfg Default log level is `DEBUG` 2023-04-17 17:28:59 +02:00
config_test_multistrategy.cfg use suitable default value 2024-03-08 17:09:19 +01:00
entrypoint.sh adapted to 3.0.4 2021-05-12 15:47:15 +02:00
logging-docker.conf Default log level for docker is now set as `INFO` 2023-04-18 09:42:04 +02:00
logging.conf Default log level is `DEBUG` 2023-04-17 17:28:59 +02:00
mail-test-config.cfg added worker for sending emails and example configuration file 2021-03-22 11:28:05 +01:00
requirements.txt homogenize requirements with the ones for docker 2024-03-08 16:37:13 +01:00
setup.cfg First share 2020-06-19 10:50:02 +02:00
setup.py major refactoring 2020-10-14 18:06:28 +02:00
test.sh Added `test.sh` to perform tests, including requirmentes installation 2023-03-14 13:24:09 +01:00

README.md

Python workers for Conductor

Python worker for Conductor provides :

  1. PyExec: a plugin based set of workers for Netflix OSS Conductor written in Python3 for

Install

Example

python3 PyExec # Runs a bare PyExec supporting only Nop, Identity and Sequence plugins
python3 PyExec Http Ansible Packer #this runs PyExec with pyrest, pyansible and pypacker plugins enabled 
python3 PyExec Shell Eval # runs a a PyExec with only pyshell and py eval enabled. pyshell executes shell commands, pyeval executes arbitrary Python3 code