Beschreibung
Dann suchen wir Sie für unseren Kunden, einem global player aus NRW.Start: 01.09.2021 (latest start: 13.09.2021)
Duration: 30.11.2021
Remote: 100%
Workload: 100%Aufgaben:
- Implementation of a new developed concept for ingestion and curation of data leveraging Azure Synapse Analytics (SPARK).
- ingest pipelines or a logical connection between a source and multiple destinations need to be created. The Curated Zone created then contains curated data that stored in a data model, which combines like data from a variety of sources.
- The developed code and pipeline are handed over to the maintenance team.
- Deep knowledge in: Python (pySPAKR, pandas and data lake delta)
- Optionally knowledge in: .Net Framework (especially C#)
- Knowledge in Common document models (JSON, XML)
- Deep knowledge in SQL
- Optionally knowledge in: Azure Dev Ops - experience with CI/CD pipeline, Azure Synapse Analytics (SPAK cluster)
- English: fluent, German: nice to have