17.05.2026 aktualisiert

**** ******** ****
100 % verfügbar

Senior Data Engineer | Snowflake · dbt · Airflow · Python | Azure · AWS · Databricks | AI-Augmented

Wellington, Neuseeland
Nur Remote
MCSE: Data Management and Reporting | Microsoft Certified Solution Expert
Wellington, Neuseeland
Nur Remote
MCSE: Data Management and Reporting | Microsoft Certified Solution Expert

Profilanlagen

Martin Xie Profile 202603.2.docx

Über mich

Senior Data Engineer with 15+ years in banking, finance and online-sales. I architect Snowflake/dbt platforms and champion AI-augmented development using Cursor, GitHub Copilot & MCP. Available for remote contracts globally.

Skills

dbtSql Data WarehouseCloud-EngineeringData ArchitectureData TransformationData Transformation ServicesDaten-VirtualisierungData WarehousingDatenbankentwicklungInfosphere DatastageDataOpsDatenbank-EnginesAWS Data AnalyticsAzure Data AnalyticsDaten-PipelineData Generation
Snowflake & dbt Data Engineering
Expert-level design and delivery of Snowflake data warehouses and dbt transformation models, including staging, intermediate, and mart layers. Proficiency in Jinja templates, dbt macros, metadata-driven pipeline generation, and Data Vault modeling, reducing manual coding by over 60%.

Cloud Data Platform Architecture (AWS & Azure)
End-to-end architecture and delivery of cloud data platforms on AWS and Azure, including medallion architecture (Bronze/Silver/Gold), AWS Lambda, Step Functions, CDK, CloudFormation, Azure Data Factory, and Azure Data Lake Gen 2. Experience migrating on-premises systems to cloud environments.

Apache Airflow & Pipeline Orchestration
Design and optimization of complex data pipeline orchestration using Apache Airflow, Control-M, and AWS Step Functions. Tuning of multi-schedule dependencies covering 90+ tables and 10+ pipelines, with virtual environment provisioning enabling sub-minute setup times.

Python & SQL Development
Advanced Python scripting for data reconciliation, pipeline automation, and ETL processes. Complex SQL development including stored procedures, transformation logic, and data extraction across SQL Server, Oracle, Redshift, and Snowflake.

Power BI & Analytics Reporting
Development of Power BI semantic models, DAX measures, paginated reports, and deployment pipelines with row-level security and governance controls. Experience with SSAS Tabular models, Power Query, and DAX optimization.

AI-Augmented Development & Prompt Engineering
Application of AI-first engineering practices using GitHub Copilot, Cursor, and MCP (Model Context Protocol) to accelerate dbt model delivery, SQL pipeline generation, and Power BI report development. Creation of structured prompt libraries for dbt macros, SQL refactoring, and reconciliation logic.

CI/CD & DevOps
Setup and management of CI/CD release pipelines for data and Power BI deployments using GitHub Actions, Azure DevOps, and AWS CDK/CloudFormation. Automated failure alerting, retry logic, and infrastructure-as-code provisioning.

Data Vault Modeling
Design and implementation of Data Vault raw vault loading pipelines including CDC (Change Data Capture), data lineage, and business vault business rules. Delivery of reconciliation frameworks validating migration outputs against acceptance criteria.

Spark, Kafka & Streaming
Experience with Apache Spark, Spark Streaming, and Kafka for large-scale data processing. Built Azure Data Factory pipelines processing 7 million semi-structured files using Spark Streaming with config-driven scaling.

Oracle & Legacy System Integration
Senior Oracle development and technical business analysis, including reverse-engineering legacy data warehouses, forward-engineering improved data models, and building custom Power BI visuals using TypeScript and D3.js.

Erfahrung

Berufserfahrungmehr als 10 Jahre
Freelancer seit2019

Sprachen

EnglishMuttersprache

Projekthistorie

Senior Analytics Engineer

ASB (Contract)
Lead analytics engineering across ASBs data platform, owning end-to-end delivery of dbt models, SQL pipelines, and Power BI reporting assets. Applied AI-prompt-first engineering to accelerate development cycles. Designed and built dbt models implementing staging, intermediate, and mart layers. Wrote and maintained complex SQL Server stored procedures. Built automated reconciliation frameworks comparing Snowflake and SQL Server datasets. Created and managed Control-M job schedules for pipeline orchestration. Developed and maintained Power BI semantic models, DAX measures, and paginated reports. Integrated AI tooling (Cursor, GitHub Copilot, MCP) into the team development workflow.

Independent Data Platform Consultant

Independent Data Platform Consultant
Delivered end-to-end data platforms and analytics solutions for 10+ organizations across NZ banking, government, and financial services. Led technical design, pipeline architecture, and delivery from requirements through to production dashboards. Specialized in cloud migration (on-prem to Snowflake/AWS/Azure), Data Vault modeling, and metadata-driven pipeline generation. Champion of AI-augmented development practices. Clients: ASB, BNZ, Ministry of Education, Heartland Bank, NZ Superfund, Volpara, OpenPoly.

Senior Data Engineer

BNZ (Contract)
Built and maintained Snowflake data pipelines using dbt and Apache Airflow. Refactored Scala and PySpark codebases to unified Snowpark code within dbt models. Designed metadata-driven pipeline generation using Jinja templates and macros, reducing manual coding by over 60%. Improved critical dataflow performance by tuning complex dependencies across 4 Airflow schedules and 10+ pipelines covering 90+ tables. Created a custom visual lineage tool adopted team-wide. Built virtual Airflow environments enabling sub-minute environment provisioning. Explored and shared AI-augmented development practices across engineering teams.

Senior Data Engineer

Ministry of Education (Contract)
Led technical design and delivery of a dbt-based data transformation platform on AWS, implementing medallion architecture (Bronze/Silver/Gold layers) end-to-end. Reverse-engineered legacy ETL pipelines to bootstrap sprint-based development cycles. Built AWS Lambda functions powering Step Function state machines for dynamic pipeline orchestration. Proposed and implemented automated CI/CD for Power BI report migration. Provisioned dbt run environments using AWS CDK and CloudFormation. Created reusable dbt macros, template code, and naming standards adopted project-wide.

Senior Data Engineer

Heartland Bank (Contract)
Refactored dbt-Snowflake models to align with new coding standards and dbt-automate features. Delivered data quality improvements and ad-hoc reporting. Refactored complex SSAS DAX calculations into optimized Power BI semantic models.

Senior Data Engineer

Heartland Bank (Contract)
Designed and built Data Vault raw vault loading pipelines including CDC (Change Data Capture), data lineage, and business vault business rules. Set up CI/CD release pipelines for data and Power BI deployments. Recreated Power BI semantic models from SSAS Tabular models and redirected existing dashboards to new models. Built a data reconciliation framework validating migration outputs against acceptance criteria.

Power BI Consultant

ASB/Qrious (Contract)
Designed and implemented Power BI deployment pipeline with role-level security and governance controls. Reviewed and improved Power BI models built by other teams. Mentored developers on Power Query and DAX best practices.

Data Engineer

NZ Superfund (Contract)
Designed event-driven data integration architecture using microservices with REST API and MSMQ message queuing. Improved Power BI report performance and proposed new logical data models aligned with analytical use cases. Built CI/CD release pipelines with Azure DevOps for automated deployment.

Senior Data Engineer

Volpara (Contract)
Designed a cloud data warehouse solution on Azure, gathering requirements with business stakeholders. Built Azure Data Factory pipelines processing 7 million semi-structured files using Spark Streaming with config-driven scaling. Designed the orchestration framework under GDPR compliance requirements.

Data Warehouse & Power BI Developer

Kohanga (Contract)
Built an end-to-end data warehouse on Azure with Power BI as the visualization layer. Designed logical data models as reporting prototypes for stakeholder alignment. Implemented SSAS Tabular models with best-practice design principles. Automated data ingestion pipelines with Azure Data Factory.

Senior Oracle Developer / Technical BA

BNZ (Contract)
Worked with data architects to design a new AWS data warehouse. Reverse-engineered and documented the legacy data warehouse; forward-engineered an improved data model. Built custom Power BI visuals using TypeScript and D3.js to visualize data lineage.

Senior BI Consultant

Theta (Consultancy)
Delivered tailored BI solutions and data platforms for 10+ clients across NZ. Built 20+ Power BI dashboards and reports. Set up enterprise Power BI platforms including gateways, row-level security, and deployment pipelines. Designed ETL processes for data warehouses using PL/SQL and T-SQL. Migrated on-premises data systems to cloud platforms. Identified and resolved performance bottlenecks in existing BI systems. Delivered presentations and bespoke training to end users.

Zertifikate

MCSE: Data Management and Reporting

Microsoft

2018

Portfolio

Kontaktanfrage

Einloggen & anfragen.

Das Kontaktformular ist nur für eingeloggte Nutzer verfügbar.

RegistrierenAnmelden