Beschreibung
Our client, a leading consultancy, are seeking a Data Engineer to join their team in Munich, Germany on a 6 month rolling contract.
Tasks:
- Develop a data models for structured and unstructured data with SQL DB, noSQL, Parquet
- Develop batch data pipelines for collecting, cleaning and archiving big data with Azure Data Factory, SPARK, Python, DataBricks
- Fetch data from various sources, including Web services, shared drives or database connections
- Deploy the solution to a productive environment in MS Azure cloud
- Support in the definition of the solution architecture with various business units
- Support the development of an energy analytical solution API implementation
Skills:
- Degree in Computer Science or related technical discipline.
- Experience in modelling and processing time series data-
- Experience in data pipeline development with Azure Data Factory and DataBricks
- Experience in Python development preferably with PySPARK
- Experience in modelling data on RDBMS, noSQL, Parquet
- Experience in Web Service development with REST and SOAP
- Experience in deploying API services in a cloud environment preferably AZURE
For more infomation, please contact Kirsty and email your CV to (see below)