Beschreibung
Our client is currently looking for a Senior DeV Ops Web Engineer (m/f) for a project in Berlin.
Job Requirements:
As part of the Engineering Support Team, you will be responsible for researching ways to improve the software building process and for sharing production information with Technology teams with focus on providing solutions for builds, releases and controls throughout the software lifecycle. Part of the responsibilities will be to understand and support DevOps culture. Scripting, documentation, process definition and automation are primary tasks, as is interacting with Site Operation team and other Technology teams. Build and deployment automation, and version management will be a large part of this position
- Located within the site operations group, the engineer (m/f) will support a separate data team by bringing their use-cases and workloads to an Openstack cloud. We rely on dual datacentre and switchover capabilities, so that a general understanding of these challenges is desired and additional engineering might be needed. Git/Github, Saltstack and Jenkins are used for automated system integration. Sensu is used for monitoring.
- The Cloudera Hadoop cluster is provided as a service by another group, so that the engineer can concentrate on the architectural part of the product development itself including production-ready stability and performance analysis.
- Data pipelines might have to be designed properly from the beginning to the end. Solutions should in general follow the KISS principle, but we value proactive and innovative colleagues by providing trust and freedom of action.
Skills:
- Experience and proficiency in data automation and management, particularly Hadoop, HDFS and Spark
- Experience with Elasticsearch, Apache Cassandra and Apache Kafka as search and data backends
- Experience configuring and spawning cloud instances (Openstack, AWS, Azure)
- Experience using ansible or saltstack environments for the cloud is a big plus
- Experience in managing and using data with relational databases, e.g. MySQL and Sqoop
- Experience with Cloudera Hadoop Distribution is a big plus
- Experience using GIT and preferably github are a big plus
- Experience with java applications (Streams, Akka) are a big plus
- Knowledge of Talend software or other data ingestion pipelines is a plus
- BS or MSc in computer science or related field.
Duration: 6 months
If this is of interest to you, please send us your CV (incl. all necessary contact details [name, address, telephone numbers, Email]) referring to the project name and relevant contact person. Please refrain from sending several attachments. We would appreciate any info concerning your availability and rate expectations. We look forward to receiving your application.
We live diversity and equality of opportunity. That is why we enable equal participation for people with disabilities and encourage everyone to apply. All person related formulations in our job advertisements are considered to be gender neutral.