Beschreibung
Our Data Scienec Team on the client side is looking for two Data Engineers, for the our product area-Trading Analytics. Trading Analytics project are using different data sources such as sales, clickstream, inventory .The intention is to transform and materialize this data sets to be available in TA application like Dynamic Pricing, Stock Optimization, Forecasting and Dashboards
Therefore we need Engineers to migrate workflows from Alteryx to Spark/Scala.
Project start: April - Mai
Project end: June 2019 (long term possible 1-2 years)
Project art: Full time
The project can be done remotly, 1 week per month on site in Herzogenaurach is necessary.
Must Haves:
• Experience with data processing and manipulation in Scala (Python a plus)
• Experience with integration of data from multiple heterogeneous data sources
• Experience with data processing, warehousing technologies such as Spark, Hive
• Experience with SQL and data modelling
• Understanding of NoSQL data modelling
• Analytic skills related to working with unstructured datasets
• Experience with file formats (e.g. Parquet; json)
• Experience with cloud computing platforms, we use AWS (S3, EMR)
• Experience with Jenkins pipeline and CI&CD automation
• Understanding of NoSQL data modelling
• Understanding and using REST API
Nice to Haves:
• Knowledge about agile software processes
• Experience with Elasticsearch
• Experience with Kubernetes/Docker
• Experience with Bitbucket
Interesting? ONLY if you are a FREELANCER. Please send us your CV in English with your daily rate and availability.