Beschreibung
Consultant Data Utility Connection (m/f/d)
Reference: -en
Start: asap
Duration: 3 MM++
Main tasks:
- HDF Integration and Data Utility Collection
- Technical consultation for and implementation of Azure Databricks transformations (SQL or Python) of data stored in Azure Data Lake (from several data sources, e.g., IoT and process data) so that is can be accessed efficiently
- Technical consultation for and implementation of “delta transformations”, i.e., transformation of only new data since the last transformation (e.g., daily or hourly)
- Set up Databricks jobs for the above transformations considering dependencies between them (e.g. Job A must be finished before Job B can start)
- Creation of (automated) tests for the above solutions
- Creation of hand-over documents (operational task list, operational handbook, infrastructure sheet) for maintenance team
- Remote training of the maintenance team about implemented transformations (probably 1-3 sessions, depending on the complexity)
Main qualifications
- Experience with HDF and Data Utility Collection
- Very good knowledge of English
Main advantages:
- Exciting project
About us:
IT specialists hold all the cards: for its customers in industry and the public sector, Hays is looking for motivated employees who like looking at the bigger picture and growing with new challenges. We make sure that you benefit from our many years of experience in IT recruitment and will find you the right role to suit your skills and interests – all completely free of charge to you. Register with us and reap the benefits of job offers that are both interesting and relevant to your skills and experience.
My contact at Hays:
My contact person:
Shiu Mun Li
Referencenumber:
Make contact:
Email: