Beschreibung
Für meinen Kunden im Medienumfeld bin ich aktuell auf der Suche nach einem Data Engineer (m/w/d).Beschreibung
Experience: 4+ years (relevant project experience after finished education)
we are looking to on-board a Data Engineer: candidates need to be able to take over the backend operations of a tv attribution tool and work closely with our product managers and our technical team
Tasks:
- Monitoring and (quality) assurance of the daily load runs
- Monitoring and (quality) assurance of data deliveries from the various data sources
- Reloading and reprocessing of data (TV and tracking data)
- Adaption and Maintenance of master data table (onboarding of new customer in backend)
- Memory management of shared cluster and HDFS
Must Have:
- Dealing with ETL processes, especially Pentaho Data Integration
- Knowledge in databases like postgres
- Knowledge in Hadoop ecosystem, esp. Hive + HDFS
- Basic Knowledge in Linux
- Basic Knowledge in Spark
- Experience in dealing with ticket system Jira and Confluence
- Experience in git
- Fluent English and German speaking
Nice to have:
- Experience in AWS (S3, Athena, Lambda, Glue, Step Functions, Dynamo DB, SNS, …)
- Experience with CICD Pipelines and Infrastructure as Code (Cloud Formation / Stacks & Stack Sets)
- Knowledge in MongoDB (Atlas), NodeJS, Angular
Einsatzstart: 01.07.21
Vorauss. Einsatzende: 31.12.21
Arbeitszeitmodell: 40 Std/Woche
Einsatzort: München / Remote
Interesse?
Dann schicken Sie gerne Ihren aktuellen CV, sowie Ihre Stundensatzvorstellung über den Bewerberlink zu Händen Herrn Fritz zu.