Data Engineer / mostly REMOTE (m/w/d)

Vertragsart:
Remote
Start:
05.2019
Dauer:
6 Monate (Verlängerung möglich)
Ort:
herzogenaurach
Eingestellt:
01.04.2019
Land:
flag_no Deutschland
Projekt-ID:
1750509


Projektbeschreibung

Our Data Scienec Team on the client side is looking for two Data Engineers, for the our product area-Trading Analytics. Trading Analytics project are using different data sources such as sales, clickstream, inventory .
The intention is to transform and materialize this data sets to be available in TA application like Dynamic Pricing, Stock Optimization, Forecasting and Dashboards
Therefore we need Engineers to migrate workflows from Alteryx to Spark/Scala.

Project start: April - Mai
Project end: June 2019 (long term possible 1-2 years)
Project art: Full time
The project can be done remotly, 1 week per month on site in Herzogenaurach is necessary.

Must Haves:
• Experience with data processing and manipulation in Scala (Python a plus)
• Experience with integration of data from multiple heterogeneous data sources
• Experience with data processing, warehousing technologies such as Spark, Hive
• Experience with SQL and data modelling
• Understanding of NoSQL data modelling
• Analytic skills related to working with unstructured datasets
• Experience with file formats (e.g. Parquet; json)
• Experience with cloud computing platforms, we use AWS (S3, EMR)
• Experience with Jenkins pipeline and CI&CD automation
• Understanding of NoSQL data modelling
• Understanding and using REST API

Nice to Haves:
• Knowledge about agile software processes
• Experience with Elasticsearch
• Experience with Kubernetes/Docker
• Experience with Bitbucket

Interesting? ONLY if you are a FREELANCER. Please send us your CV in English with your daily rate and availability.