Beschreibung
Role: Freelance Data Engineer (AWS, Data Lake, Python)Location: Remote / 10% Frankfurt
01.09.2022 - 31.12.2022 (with extension option)
Full time
Project language: German
# Project description
This individual request has the following content for the project:
• Ensure IT security and governance as well as operational management of the data platform in the AWS cloud including test automation and configuration management
• Operational management, further development and implementation of data models for recording and mapping the qualitative provision of services
• Operational management, preparation and calculation as well as the economic effects thereof in the data analysis tool Qlik Sense
• Operational management and further development of a data model for the billing of the services provided with subsequent data preparation for the ERP system
• Operational management of the visualization of calculated results in the Qlik Sense reporting system
# Service description
• Operational management and further development of the data platform in the AWS Enterprise Cloud and ensuring IT security and governance
• Optimization of data architectures, Python, SQL and Gitlab CI/CD pipelines incl. test automation, configuration management
• Operational management and further development of data models for Qlik-Sense dashboards
• Operational management of data analyses and their visualization in Qlik Sense
• Connection of data from different data sources and implementation in an automated charging route
• Implementation of monitoring functions of automated loading processes
• Identification of data quality deviations and development of cleansing processes
• Documentation of the developed architectural elements and processes
• Versioning and documentation of the developing scripts
• Bug fixing in case of error
•
# requirements
• At least 3 years of experience with the operational management of a data lake in the AWS cloud with Linux, Airflow, AWS S3, Redshift, RDBMS Datenbanksystemen (PostGres und Oracle)
• At least 3 years of experience in writing and optimizing Python, SQL and Gitlab CI/CD
• Pipelines incl. test automation, configuration management
• At least 3 years of experience with ETL, data modelling and data architectures
• At least 2 years of experience with reporting solutions, preferably Grafana, QlikSense
• At least 2 years in IT security and IT networks