Beschreibung
Senior Data Engineer (m/f/d) with Languages English; German (not required, but helpful)Westhouse is one of the leading international recruitment agencies for the procurement of highly qualified experts in fields such as IT life cycle management, SAP, engineering, commerce and specialist consultancy.
For our client we are currently looking for a
Senior Data Engineer (m/f/d)
General information
Reference: 149863
Location: Remote, maybe Munich + New York
Start: 16.08.2021/01.09.2021
Volume: Full time
Duration: 31.12.3022
Languages: English; German (not required, but helpful)
Your Skills
- 5+ years of experience with data modelling, data processing, and data analytics as data engineer
- 5+ years of hands-on Python and SQL experience required
- Expert Data Model skills on designing and building models for semi-structured, relational, graph data
- Expert SQL skills including T-SQL, Hive, Spark SQL, etc
- Expert Knowledge in database technologies such as Postgres, SQL Server, MySQL, MongoDB, Azure CosmosDB
- Experience in data pipeline development using Azure Data Factory, T-SQL, PySpark, Airflow, etc.
- Cloud Analytics stack (eg Azure: Data Factory, Databricks, Azure ML, Azure SQL, ADLS)
- (t-)SQL + Tools + Ecosystem (SSMS, Azure Data Studio, Azure SQL)
- Scripting knowledge (bash, Powershell or Python)
- 3+ years of hands-on Microsoft Azure experience highly preferred
- Experience in P&C insurance industry (preferred experience working with insurance homeowner data) (nice to have)
- Experience with data visualization tools such as Power BI (nice to have)
- Azure DevOps esp. repositories, pipelines (nice to have)
Your Tasks
- The technology product is a strategic initiative of our client which operates in two locations, Munich and New York City. Our client operates as a technology startup as part of a big insurance company. The technology product is designed and built based on modern software engineering paradigms, has data enabled automation at its core and started to get deployed at scale. The solution combines the client's actuarial and modelling expertise with machine learning.
- Build and maintain technology product's Data/ML Platform
- Build and maintain robust scalable data processing pipelines in Microsoft Azure
- Optimize data ingestion process for better reliability and throughput
- Design and develop data models for analytics
- Work with various complex data sources at various levels of granularity and deliver high-quality data
- Drive data architecture design decisions considering future growth
- Work closely with actuaries and data scientists to understand their objectives and translate to ensure architectural fit
- Own features from design through delivery with ongoing support
- Communicating effectively across diverse disciplines (with Product Management, Data Science, Actuarial, etc) to collect requirements
- Experience providing clear data engineering technical leadership, mentoring, and best practices for data management and quality within and across teams
Interested?
We look forward to receiving your application documents in electronic form.