Upgrade Projekt einstellen
Profilbild von Anonymes Profil, Senior Data Engineer
München
verfügbar

Letztes Update: 10.11.2023

Senior Data Engineer

Abschluss: Informatik
Stunden-/Tagessatz: anzeigen
Sprachkenntnisse: deutsch (Muttersprache) | englisch (verhandlungssicher)

Schlagwörter

Dateianlagen

Patrick-Ruoff-Curriculum-Vitae_080923.pdf

Skills

Python, Azure, Databricks, PySpark, SQL, dbt, Apache Airflow, Apache NiFi, ETL, Shell, CI/CD, Terraform, Elasticsearch, Kibana, Docker, Azure DevOps, Gitlab CI/CD, Airflow, NoSQL, data modeling, scikit-learn, Python, Azure Data Factory, Event Grid, MS SQL, Logic Apps, Blob, ADLS, Queues, Scrum, Git, Clean Code, NumPy, pandas, Bash, IoT data, Jupyter, RDBMS, PyTest, client-facing communication, Atlassian Stack, UML, Flask 

Projekthistorie

11/2022 - bis jetzt
Senior Data Engineer
Bundesamt für Zoll und Grenzsicherheit (Schweiz) (Transport und Logistik, 1000-5000 Mitarbeiter)
Part of two agile teams (18 members) providing data analytics platform for customs and border security business departments. Redesigned ETL architecture for ~60 data products processing customs and personal data. Improved performance by factor of ~100. Technical lead in decision making with architects and review of Pull-Requests and tickets of 12 developers.
01/2022 - 09/2022
Senior Data Engineer
inovex GmbH (Industrie und Maschinenbau, >10.000 Mitarbeiter)
Part of agile team ( 30 members) providing cloud data platform for industry-leading business
departments. Designed and implemented architecture for *30 ETL applications and APIs
processing global IoT data on a terabyte scale. Deployment of various managed services in
hybrid cloud setup. Enablement of client developers. Optimized storage to save *4000€ per
month.
Skills: Python, Azure, Databricks (Delta Lake), PySpark, SQL, NiFi, Shell, CI/CD, Terraform
09/2020 - 12/2021
Data Engineer
inovex GmbH (Industrie und Maschinenbau, 1000-5000 Mitarbeiter)
Designed and implemented architecture for ETL and dashboarding application for IoT data.
High focus on security for sensitive laboratory data on Azure. Realized clean software
architecture principles for maintainability of 11 Python projects. Reduced processing time by
a factor of *50. Conducted requirements engineering as main contact for stakeholders.

Skills: Python, Azure, Elasticsearch, Kibana, Shell, CI/CD
02/2021 - 09/2021
Data Engineer
inovex GmbH (Industrie und Maschinenbau, 1000-5000 Mitarbeiter)
Part of agile team (6 members) with goal to provide data-driven insights to end-users on
globally distributed IoT data of industry-leading client. Designed and implemented architecture
for ETL and machine learning applications that process data daily on a giga- and terabyte
scale. Full responsibility from raw data collection over processing with machine learning
to visualization. Deployment of various managed services in private network on Azure.
Enablement of client developers.

Skills: Python, Azure, Databricks (Delta Lake), PySpark, SQL, Shell, CI/CD, Terraform
10/2020 - 01/2021
Cloud Engineer
inovex GmbH (Industrie und Maschinenbau, 1000-5000 Mitarbeiter)
Migrated ETL pipelines and web APIs from on-premises to Docker-based services on Azure.

Skills: Azure, Terraform, Azure DevOps, CI/CD, ARM templates, Docker
06/2020 - 09/2020
ML Engineer
inovex (Industrie und Maschinenbau, 1000-5000 Mitarbeiter)
Designed and implemented on-premises ETL pipelines and web APIs for ML applications.

Skills: Python, Shell, Gitlab CI/CD, Elasticsearch, Kibana, flask
02/2019 - 05/2020
Working Student: Data Scientist
inovex GmbH (Internet und Informationstechnologie, 250-500 Mitarbeiter)
Evaluated machine learning frameworks with focus on tabular data sets.

Skills: extensive Python programming, scikit-learn, TensorFlow, PyTorch
09/2019 - 04/2020
Guest Researcher
Carnegie Mellon University (Sonstiges, 1000-5000 Mitarbeiter)
Designed and realized data collection pipeline for thermal comfort related data including
biosignals and occupant controls. Optimized, deployed and evaluated machine learning models
for infrared heating panel control with focus on interpretability. Reduced command frequency
by 79% and increased thermal comfort to 89%. Published findings (paper, code, data).

Skills: IoT, Python, scikit-learn, fastai, Swift, Cloud Computing, Expainable AI
10/2018 - 01/2019
Working Student: Data Engineer
inovex GmbH (Internet und Informationstechnologie, 250-500 Mitarbeiter)
Skills: self-responsible working, Kudu, Hadoop, HBase, Parquet

Zertifikate

Databricks Certified Data Engineer Professional
Databricks
2023
Azure Data Engineer Associate
Microsoft
2022
Associate Developer for Apache Spark 3.0 (Python)
Databricks
2022
Data Engineering
Udacity
2021

Reisebereitschaft

Weltweit verfügbar
Gelegentliche Reisen
Profilbild von Anonymes Profil, Senior Data Engineer Senior Data Engineer
Registrieren