14.12.2025 aktualisiert

**** ******** ****
Premiumkunde
100 % verfügbar

Databricks Architect, Data Engineer, Lakehouse Architect, PySpark, Spark, Azure, AWS, DevOps, Python

Frankfurt am Main, Deutschland
Weltweit
Bachelor Degree. Applied Informatics and Mathematics. Probability Theory and Statistics.
Frankfurt am Main, Deutschland
Weltweit
Bachelor Degree. Applied Informatics and Mathematics. Probability Theory and Statistics.

Profilanlagen

Azure_Solution_Architect_Data_Engineer_Certificate.pdf
AWS Certified Data Analytics - Specialty.pdf
AWS Certified Solutions Architect - Associate.pdf
Goethe_Zertifikat_C1.pdf
Databricks_Data_Engineer_Professional.pdf

Skills

JavaAgile MethodologieAmazon Web ServicesData AnalysisMicrosoft AzureContinuous IntegrationInformation EngineeringDevOpsApache HadoopPythonScalaSoftwareentwicklungSolution ArchitectureTest-Driven DevelopmentApache SparkData LakePySparkGitlab-CiAWS Data AnalyticsApache KafkaTerraformDatabricks
Expert in data engineering (Azure, Databricks, Spark, Hadoop, Kafka, AWS), software development (Java, Scala, Python), and DevOps (Terraform, Azure DevOps, AWS, and Gitlab CI/CD).
Proven track of successfully completed projects with demonstrated ability to provide highly efficient solutions in accordance with the well-architected principles and best practices (SOLID, TDD, CI/CD, Agile). Over a dozen of successfully architected and improved data analytics solutions, including 10+ projects with Databricks.
I have the following certifications and constantly upgrade my knowledge:
- Azure Solutions Architect Expert
- Azure Data Engineer Associate
- AWS Certified Solution Architect Associate
- AWS Data Analytics Specialty.

Erfahrung

Berufserfahrungmehr als 10 Jahre
Freelancer seit2020

Sprachen

DeutschverhandlungssicherEnglischverhandlungssicherRussischMuttersprache

Projekthistorie

Data Architect, Data Engineer, Databricks, MLOps, DevOps

Customer 1:
Development and operation of the Enterprise Data Lake (corporate Data Lakehouse) and Data Science Lab (reusable and secure solution, deployed for about 70 clients) automating infrastructure tasks and CI/CD pipelines.
  1. Azure Databricks, Azure AD, Azure DevOps, ADLS Gen.2, Azure Data Factory, Azure Machine Learning, MLflow.
Improved DevOps pipelines and ML infrastructure for the commodity pricing prediction project.
  1. Azure DevOps, Kubernetes, Terraform, Azure Databricks, Spark, Azure SQL, Power BI, Grafana.
Developed the cost-efficient Advanced Cybersecurity Analytics solution that consumes large volumes of highly sensitive data and transforms it in real-time.
  1. Kubernetes, Terraform, Azure DevOps, Confluent, Kafka, Logstash, Java, Rust.
Architecture and development of 3 data integration projects (B2B platform for cosmetics industry, production sites data analytics, operational data warehouse)
  1. Azure Databricks, PySpark, Kafka, dbx, Azure Data Factory, Azure SQL.
Customer 2:
Development of the corporate Data Lakehouse based on Azure Databricks, PySpark, Python, Airflow, Unity Catalog, dbx.
Development of the streaming data ingestion and processing using Kafka and Spark Structured Streaming.
Customer 3:
Building end-to-end data pipeline for the support system for medical diagnosis, architecting and developing the complete MLOps solution on Databricks and Google Cloud.
Optimizing performance for real time data processing.
- Azure Databricks, PySpark, GCP, MLflow, Streamlit.

Big Data Architekt

Ultra Tendency GmbH

Internet und Informationstechnologie

50-250 Mitarbeiter

Consulting one of the largest insurance companies in Germany to build Data Lake Cloud Concept based on Azure Databricks with a strong DevOps focus:

  • Databricks, Azure Data Factory, ADLS Gen.2, Azure AD
  • Documenting the concepts: DevOps, IAM, Cryptography, Business Continuity, Auditing, Logging. Building PoC for Terraform environments.

Interim Product Owner / Team Lead in the international IIOT project (GAIA-X):

  • Docker, Kubernetes, Java, Spring Boot, Apache Camel
  • Agile, Scrum.

Big Data Architekt

Adastra GmbH

Internet und Informationstechnologie

50-250 Mitarbeiter

Architecting the data integration framework on AWS with a strong focus on the best data management and DevOps practices:

  • Modularized and extensible implementation
  • Support of the most complex use cases in data management: Change Data Capture, Slowly Changed Dimension Type 2, schema changes
  • Auditing and data lineage
  • Support for CI/CD with test-driven development
  • Written in Python, PySpark, Pandas, Jinja2 templates, using Airflow to orchestrate ETL and maintenance jobs.

Data Engineering Tech Lead

360T (Deutsche Börse Group)

Banken und Finanzdienstleistungen

50-250 Mitarbeiter

  • Development and maintenance of the Big Data infrastructure (Cloudera Hadoop, Spark, Kafka, Impala, SQL, Scala, Python).
  • Architecting the new data processing solution in accordance with DataOps principles and requirements for auditing and data quality assurance.
  • The developed framework is based on the same technologies (Apache Spark) and architectural principles as AWS Glue, written in Java, Spring Boot, Spring MVC, Thymeleaf.
  • Overall improvements in the data infrastructure, including monitoring dashboards, custom Web applications, patching (JIRA, Python, and Bash scripts), quality assurance and CI/CD routines (JIRA, Bamboo), documentation.
  • Responsible for MIFID-II compliance reporting development, the project was successfully completed meeting the hard deadline.
  • Advanced analytics (SQL, Spark, Python, ML) on large and complex data sets (billions of records daily), both in batch and real-time.

Senior Java Developer / Data Analytics Team Lead

Phorm

Internet und Informationstechnologie

50-250 Mitarbeiter

  • Development of the digital advertising exchange platform as Senior Java EE Developer, both Back- (Java EE, Hibernate, Spring) and Front-End (Javascript).
  • Leading Data Analytics Team starting from January 2013, providing solutions for advanced SQL (Postgres DB) and multi-dimensional analysis (Pentaho Analytics, OLAP cubes).
  • Setting up the Cloudera Hadoop cluster (Oozie, Sqoop, Impala, Hive, Spark) to process large volumes of data.

Zertifikate

Databricks Certified Data Engineer Professional

Databricks

2024

Goethe-Zertifikat C1

Goethe Institut

2022

Microsoft Certified: Azure Data Engineer Associate

Microsoft

2021

Microsoft Certified: Azure Solutions Architect Expert

Microsoft

2020

AWS Certified Data Analytics – Specialty

AWS

2020

AWS Certified Solutions Architect – Associate

AWS

2020


Kontaktanfrage

Einloggen & anfragen.

Das Kontaktformular ist nur für eingeloggte Nutzer verfügbar.

RegistrierenAnmelden