Beschreibung
Our client in Hamburg is looking for an English speaking Data Infrastructure Engineer for a project.
Your Role
You will be collecting Data, storing and data processing and then serving it as an API to data scientists.
You will be building and maintaining large scale data processing systems and architect highly scalable systems using different opensource tools. You will be developing a long term vision for a full stack machine learning as service architecture based on microservices. Using a DevOps approach and full stack point of view.
You should have
Extensive knowledge of databases and best engineering practices
Handling log errors, monitoring the system, building human fault tolerent pipelines, understanding what is necessary to scale up, continious integration, database administration, data cleaning, and maintaining a deterministic pipeline.
Experience with
Hadoop, Mapreduce, Apache Spark, Apache kafka, development, data processing, ansible, docker, python, Apache mesos.