Beschreibung
Senior DevOps Expert for Big Data, Analytics and AI platformStart Date: 01.10.2020
Duration: 3 months + Regular extensions
Location: North Rhine-Westphalia
Aufgaben:
• Development and Operations of platform services
• Implementation of automation and solution business logic per requirements
• Cloud and OnPrem infrastructure setup and management
• Security assessment and application of measures
• Close work with internal customers onsite and remote: requirements gathering and definition, regular project meetings
Eingesetzte Technologien:
• AWS: S3, Lambda, Redshift, VPC, Route53, EC2, EFS, RDS, DynamoDB, API Gateway, CloudWatch, IAM, Cognito, SNS, IoT Core, Kinesis.
• Azure: Data Lake, Fuctions, Synapse, CosmosDB, DataBricks, Data Factory, ML, Events Hub, IOT Hub
• Airflow, NiFi, Serverless.com, Snowflake, Kafka
• Kubernetes (AWS, Azure, OnPremise)
• Terraform, Cloudformation, Ansible, Sparkleformation and Cloud Custodian
• ActiveDirectory / LDAP
• CI/CD
• JupyterHub/Lab
Skills:
• Proven practical DevOps experience (7+ years) in cloud-based environments for Big Data and Data Science applications
• Solid practical knowledge of Cloud services, its setup and integration (see list of technologies)
• Practical knowledge of management and configuration services and tools (see list of technologies)
• Practical knowledge of cloud-based container tools/services, its setup, security, monitoring and operations.
• Programming/scripting skills. Python preferred, more languages - nice to have. Experience with PySpark is nice to have.
• Practical experience with processing of streaming data, including real-time analytics and data transformation.
• Practical knowledge of data processing and integration patterns, such as ETL, ELT, etc.
• Knowledge of data science tools (at least on a basic level).
• Solid knowledge of Linux.
• Practical knowledge of ActiveDirectory / LDAP.
• Monitoring of Azure and AWS services and logs analysis.
• Knowledge and practical experience around cloud security (Azure and AWS).
• Practical Knowledge of GIT and CI/CD. Experience with GitLab.
• Very good level of English is required (speaking and writing). Knowledge of German is very welcome
additional Language: Dutch
Please contact at for further details.
Stephen Mojsak
MPSearch Ltd