Beschreibung
Wir sind für unseren Endkunden auf der Suche nach Unterstützung.Angebote gehen bitte unter der ID SP-14725 an recruiting at it-p.de
Zeitraum: 11.09.2017 - 11.12.2017
Ort: München, Essen, Hannover, Quickborn (wird noch definiert)
Stunden: 480 Stunden
Sprachanforderung: deutsch, englisch
Aufgabe:
• Test driven development with Scala and the Apache Spark framework
• Creating data pipelines to create the data preparation layer within the project
• Translating existing complex data preparation SQL queries to Scala
• Create content for new analytics modules whilst communicating with other teams and developers
• Be a part of an international team
Soft-Skills:
• Test driven development with Scala and the Apache Spark framework
• Creating data pipelines to create the data preparation layer within the project
• Translating existing complex data preparation SQL queries to Scala
• Create content for new analytics modules whilst communicating with other teams and developers
• Be a part of an international team
Fach-Skills:
• Experience with TDD , Git
• Experienced in Scala and/or Python and Unix/Linux environment
• Proficient with Microsoft Azure and Hortonworks stack.
• Experience with the Spark framework
• As a Data Engineer, you should have knowledge of big data technologies such as Hadoop, HBase, Hive , ETL frameworks
• Ability to event stream pipelines (Storm, Kafka, Kinesis, ...)
• The ideal Data engineer has a history of Machine Learning if preferred
• Good understanding of the Data Science lifecycle
• Good knowledge of infrastructure automation software/tools such as Chef, Terraform and/or Docker
• Advantageous would be knowledge and experience in administrating SQL and NoSQL databases
• Advantageous would be knowledge in Scala and Python
• Fluent in English is a must