Beschreibung
Our client, a large data science consultancy company, are looking for a Data Intelligence Architect for a 3 month project. This project is entirely remote. The project is in the transport industry and the project language is German.Project description
In an interdisciplinary team we develop agile methods in the areas of big data analytics, mathematical optimisation and simulation. We use these methods in all business areas of the company in order to make planning and operating processes more efficient and to tailor our services better to the needs of railway customers. We operate servers in the cloud (Amazon AWS) and on-premises (OpenStack). The most important data pipelines are currently still running on-premises. In the medium term, a migration to the AWS cloud is planned. Due to the dependencies between loading routes, data and projects, the migration must be well prepared. For this purpose we are looking for support in order to work on a concept for migration to the cloud and to implement and test individual elements in a prototype.
Role Responsibilities
- Architectural consulting in the development of a data platform based on Amazon Web Services (AWS)
- Conceptual support for the migration of existing (on-premises) solutions to AWS
- Recording of requirements from the company IT department with regard to security and general IT strategy
- Implementation of a proof of concept
- Management of requirements in Jira
- Documentation in Confluence
- Code management in GitLab
Must-Have Skills
- At least 3 years of experience in data engineering in an enterprise environment
- At least 3 years experience in the conception and development of data architectures in the Amazon AWS Cloud
- Experience in the design and code-based development of ETL routes
- Very good knowledge of SQL
- Very good knowledge of Python
- Experience in code management using Git
Preferable Skills
- Experience in the conception and development of Postgres and MS SQL databases
- Experience in a higher programming language (e.g. C#)
- Experience in scheduling with Jenkins and Windows Task Scheduler
- Experience in handling streaming data
- Experience in working with geodata in PostGIS
- Experience in monitoring and alerting of ETL routes with e.g. Prometheus and Grafana or AWS CloudWatch
- Experience with enterprise network environments (firewalling, security)
- Experience with LDAP, Kerberos and SSO
- Experience with OpenStack
- Experience of working in agile teams
- Jira
- Confluence
If you are interested in this position, please send your CV to XXX and we will contact you shortly.
We would also ask you to send on a short self-seller explaining your experience using the skills above.
Many thanks.
e-mail: