Beschreibung
For our client in Dusseldorf, we are currently looking for a Consultant Architecture with experience with the tool Airflow.Start: asap
Duration: 3 months
Volume: 40h/ week
Location: Dusseldorf
Remote: possible
Project language: English
Project background:
The client is planning to implement Airflow scheduling and is therefore looking for a specialist who has experience with this tool.
Project Description:
- To be set up so that Run/ Maintenance can be outsourced to 3rd party provider
- Airflow needs to run in Docker
- Hosting on a PaaS solution preferred Kubernetes-based, fully managed Postgres database
Task Description:
- Set up and configuration using common configuration management tools (e.g. Terraform, Ansible)
- Network integration to the client on premise
- Automated Deployment allowing for full provisioning of an Airflow environment including all required components ( Also covers local Deployment for Development purposes )
- Integration with Authentication services (AD, Azure AD)
- Central logging of all Airflow components
- Alerting system on several layers (e.g. CPU, RAM, DISC, Service Availability like http)
- Design and Implementation of Usage Concept which allows for Versioning of DAGs, local Development and Test and automated, unchanged deployment to an Airflow environment
Required Skills:
- Experience with the tool airflow scheduling
- Experience with configuration management tools like Terraform or Ansible
If this interests you:
Spoorthy Suneel (LinkedIn)
Michael Bailey International is acting as an Employment Business in relation to this vacancy.