Azure Data Engineer

Beschreibung

Azure Data Engineer
Remote / Work from Home
4 Months initially
ASAP
€/day

Experience:
• Working in an agile environment
o Participate in daily stand-ups, articulating the stories worked upon, blocking issues and their status.
o Participate in sprint planning, estimating stories, providing proposed solutions and identifying stories that are not ready for planning
o Developing solutions and unit tests from requirement and acceptance criteria
• Working with cloud services
o Good working knowledge of Azure data services e.g.: Azure SQL Database options, Azure Cosmos DB, Data Lake, Azure Storage, Data Factory, Databricks.
o Good working Knowledge of Azure Key Vault, Azure Functions, Logic Apps, Power BI
o Ability to debug issues with a development or PR environment and understand if the environment is representative of the production infrastructure.
• Languages and tooling
o Proficient (over a years' experience) with both Python (in a Spark environment) and SQL
o Experience with scripting languages such as PowerShell or bash
o Knowledge of using debugging tools, profilers, and linters.
o Understanding of Test-Driven Development

Skills:
• Able to work with Business Analysts to ensure stories are implementable and have workable acceptance criteria
• Able to discuss problem solutions in a reasoned and dispassionate way
• Able to implement business requirements as software components with accompanying unit tests and integration tests as required.
• Good knowledge of Azure DevOps Pipelines is ideal but knowledge of any other Enterprise product/tool for CI/CD is also considered, e.g.: Terraform, Jenkins, etc.
• Able to manage branching and pull requests and engage in peer code reviews.
• Ability to modify CI/CD pipelines as required, without adversely impacting the work of colleagues.
• Knowledge of delivering solutions in the Databricks/Spark environment – architecture, execution and debugging.

Desirable Certifications:
• Certifications (Non-essential but desirable)
• DP-900 Azure Data Fundamentals
• Databricks Certified Associate Developer for Spark 2.4/3.0