20.09.2026 aktualisiert
verifiziert
100 % verfügbarSenior Data Engineer & AI Architect (DWH/AI/Cloud)
Warszawa, Polen
Nur Remote
Bachelor Engineering Computer ScienceÜber mich
Senior in Data ETL processes, DWH, BI, AI & Cloud (Azure, AI Services the last 5years) Specialized in designing scalable architectures, real-time ETL/ELT pipelines, and AI-driven solutions using Azure, Databricks, Snowflake. Combines deep expertise in SQL/Python on Generative AI, LLM, RAG, and MCP
Skills
Azure DatabricksBMC Remedy Action Request SystemUNIXPythonMicrosoft Power BIKustoShell-ScriptSnowflakeAzure PowerShellCosmos DB
Generative AI & LLM Integration
End-to-end LLM pipelines using Azure OpenAI, including fine-tuning and optimization. RAG architectures with vector databases such as Pinecone and Azure Cognitive Search. Building autonomous AI agents with LangChain, LangGraph, and MCP frameworks. Prompt engineering with few-shot learning and chain-of-thought optimization.
Data Engineering & ETL Pipelines
Design and implementation of medallion data architectures (Bronze/Silver/Gold) for batch and streaming. Advanced ETL automation using @dlt.table, quality controls, and apply_changes() for SCD Type 2. Expertise with Spark SQL, Databricks, Scala, Snowflake, Azure Data Factory, Python, and ELK Stack.
Cloud & Big Data Architecture
Deep expertise in Microsoft Azure services including Synapse, Data Lake, and Databricks. Snowflake centralization for analytics, secure data pipelines, and GDPR-compliant implementations. Data warehouse design and implementation for enterprise-scale analytics with multi-cloud design patterns.
ML Pipelines & MLOps
Training pipelines, automated feature engineering, and model monitoring using MLflow and Azure ML registries. Production model lifecycle management and CI/CD for ML models.
Control-M Scheduler & Orchestration
Administration and workflow automation using BMC Control-M, ensuring execution of data pipelines and batch processes. Job scheduling with Apache Airflow and Python crontab.
Business Intelligence & Data Analytics
Strong background in BI reporting using Power BI, ADF, Tableau, SAS, and Informatica Powercenter. Transforming complex datasets into actionable insights for executive stakeholders.
SAS Programming & Analytics
SAS Advanced Programming 9.4 including macros, data manipulation, and SAS Visual Analytic tool (Viya 9.4). SAS DI ETL development, SAS Monitor transaction, and dimensional Oracle Modelling OLAP cube design.
DevOps & Security
GitHub Actions, Docker, Kubernetes (EKS/AKS), KeyVault, and Zero-Trust architecture. AI/ML governance, responsible AI, and compliance for regulated industries.
Vector Databases & Semantic Search
Implementation of vector search solutions using Pinecone, Azure Cognitive Search, and Semantic Kernel. Integration with generative AI frameworks for retrieval-augmented generation systems.
SQL & Database Technologies
Expert in complex SQL queries across T-SQL, PL/SQL, SQL Nativo, Azure SQL Database, Azure Synapse Analytics, and SQL Server. Deep knowledge of Oracle/Teradata, stored procedures, and SQL optimization.
End-to-end LLM pipelines using Azure OpenAI, including fine-tuning and optimization. RAG architectures with vector databases such as Pinecone and Azure Cognitive Search. Building autonomous AI agents with LangChain, LangGraph, and MCP frameworks. Prompt engineering with few-shot learning and chain-of-thought optimization.
Data Engineering & ETL Pipelines
Design and implementation of medallion data architectures (Bronze/Silver/Gold) for batch and streaming. Advanced ETL automation using @dlt.table, quality controls, and apply_changes() for SCD Type 2. Expertise with Spark SQL, Databricks, Scala, Snowflake, Azure Data Factory, Python, and ELK Stack.
Cloud & Big Data Architecture
Deep expertise in Microsoft Azure services including Synapse, Data Lake, and Databricks. Snowflake centralization for analytics, secure data pipelines, and GDPR-compliant implementations. Data warehouse design and implementation for enterprise-scale analytics with multi-cloud design patterns.
ML Pipelines & MLOps
Training pipelines, automated feature engineering, and model monitoring using MLflow and Azure ML registries. Production model lifecycle management and CI/CD for ML models.
Control-M Scheduler & Orchestration
Administration and workflow automation using BMC Control-M, ensuring execution of data pipelines and batch processes. Job scheduling with Apache Airflow and Python crontab.
Business Intelligence & Data Analytics
Strong background in BI reporting using Power BI, ADF, Tableau, SAS, and Informatica Powercenter. Transforming complex datasets into actionable insights for executive stakeholders.
SAS Programming & Analytics
SAS Advanced Programming 9.4 including macros, data manipulation, and SAS Visual Analytic tool (Viya 9.4). SAS DI ETL development, SAS Monitor transaction, and dimensional Oracle Modelling OLAP cube design.
DevOps & Security
GitHub Actions, Docker, Kubernetes (EKS/AKS), KeyVault, and Zero-Trust architecture. AI/ML governance, responsible AI, and compliance for regulated industries.
Vector Databases & Semantic Search
Implementation of vector search solutions using Pinecone, Azure Cognitive Search, and Semantic Kernel. Integration with generative AI frameworks for retrieval-augmented generation systems.
SQL & Database Technologies
Expert in complex SQL queries across T-SQL, PL/SQL, SQL Nativo, Azure SQL Database, Azure Synapse Analytics, and SQL Server. Deep knowledge of Oracle/Teradata, stored procedures, and SQL optimization.
Erfahrung
Berufserfahrung5 - 10 Jahre
Freelancer seit2022
Sprachen
EnglishMutterspracheSpanishMuttersprache
Projekthistorie
Experienced Data & AI Engineer specializing in DWH, BI, and Azure/Snowflake Cloud Solutions. Spearheaded implementation of medallion data architectures in production, leveraging @dlt.table and apply_changes() for SCD Type 2. Focused on LLM integration, RAG architectures, and MCP servers for model management. Developing ETL workflows and data pipelines for financial risk analytics, enhancing data integration across Azure and Snowflake, and improving data governance, quality, and compliance.
Working in the data science team cooperating closely with clients on analytical and modeling topics including pricing, optimization, supply chain analytics, and international testing guidelines. Fraud detection using SAS AML framework and SAS Studio 9.4. Driving implementation of a data science architecture for machine learning solutions industrialization. Implementing ETL technologies open source (Elastic Search, OpenStack, Docker, Splunk, Snowflake). Technologies: Azure, Databricks, Python, PySpark, ADF, AirFlow, SnowFlake, SQL, NumPy, Jupyter Notebook, Tableau, K8.
Architect Banking Consultant providing DWH, BI, and Analytical Solutions, implementing multiple business processes in SQL (Oracle/Exadata) and Python. Full implementation using BMC ControlM for all orchestration. Skills included Unix, Databases, Data Migration, Agile Methodologies, SAS Programming, Business Analysis, Banking, Bash, ElasticSearch, Oracle Database, Netezza, DWH, Shell Scripting/Python, Azure, Databricks, Python, Snowflake, Airflow, PySpark, R, SQL. Agile project management using Jira for 14 years.