Beschreibung
Our client is looking for an Azure Data Engineer freelancer for a remote full time contract.
The task will be to:
- Implement Business Intelligence Architecture within Azure.
- Use PySpark within Databricks, or using SQL within Azure SQL DBs or Synapse to build ETL/ETL pipelines based on existing business rules/logic
- Deal with structured JSON data that's coming from Azure Data Lake
- Develop data modells & data mart within Azure SQL DBs or Synapse
- Generate ETL/ETL jobs using Azure DataFactory
- Configure Azure DataFactory pipeline monitoring and alert systems
You must have:
- Azure Cloud exp
- Azure Data Lake (storage) exp
- Spark/Databricks exp
- DWH & Data mart eg synapse and SQL DB exp
- Python exp
- SQL exp
- ETL/ETL exp
- Implementation of complicated business rules/logic
- Azure DevOps exp, esp Repositories and Pipelines
- DataFactory
If you'd be interested or know someone that might be, please get in touch.
Kind Regards,
Andy