Data Engineer- Python / Azure
IDPP Consulting Limited
Ansprechpartner: Satnum Sidhu
frankfurt, Deutschland
ITMicrosoft AzureCloud-EngineeringData ArchitecturePythonAzure SQLDataOpsAzure Machine LearningAzure Data LakeAzure AutomationAzure Data FactoryInfrastructure as Code (IaC)Azure Data AnalyticsDaten-Pipeline
Beschreibung
Data Engineer- Python / Azure
We are building a future-proof data foundation that enables critical business applications, reporting capabilities, and digital customer services, unlocking greater value from operational data.
- Design, develop, and maintain components of an Azure-based data platform using Python, CosmosDB and DeltaTables.
- Build and integrate containerized workloads running on Azure Container Apps.
- Take ownership of technical topics independently, from solution design through implementation, testing, and deployment.
- Develop well-tested code following established software engineering and Python best practices.
- Implement appropriate error handling, logging, monitoring, and operational safeguards for production workloads.
- Collaborate with other developers, data engineers, and stakeholders to deliver reliable end-to-end solutions.
- Review existing implementations and proactively identify opportunities for improvement, simplification, and increased maintainability.
- Consult the preparation and stabilization of the platform for production go-live, covering (automated) deployment to separate environments.
- Contribute to CI/CD pipelines and automated deployment processes.
- Where applicable, contribute to Infrastructure as Code (IaC) and the automation of Azure infrastructure provisioning and configuration.
Requirements:
- Python
- Microsoft Azure
- CI/CD (Continuous Integration / Continuous Deployment)
- 5+ years Python development experience with the ability to work independently and make sound technical decisions based on software engineering best practices
- Strong hands-on experience with Python-based time series data processing
- Experience developing and operating containerized applications on Azure
- Experience working with CI/CD pipelines and automated deployment processes
- Proven ability to write production-ready, well-tested, and maintainable code
- Ability to independently analyze problems, develop solution approaches, and implement them end-to-end
- Experience working in environments preparing data platforms for production go-live
- Experience with Azure-based cloud environments and modern DevOps practices