Beschreibung
Project Description:To be set up so that Run/Maintenance can be outsourced to 3rd party provider
Airflow needs to run in Docker
Hosting on a PaaS solution preferred Kubernetes-based, fully managed Postgres database
Task Description:
Set up and configuration using common configuration management tools (e.g. Terraform, Ansible)
Network integration to client on premise
Automated Deployment allowing for full provisioning of an Airflow environment including all required components
Also covers local Deployment for Development purposes
Integration with Authentication services (AD, Azure AD)
Central logging of all Airflow components
Alerting system on several layers (e.g. CPU, RAM, DISC, Service Availability like http)
Design and Implementation of Usage Concept which allows for Versioning of DAGs, local Development and Test and automated, unchanged deployment to an Airflow environment
Airflow experience is a must
Language skills:
English
Start: ASAP
Duration: 3 months+