Beschreibung
For our client we are looking for a Scala / Spark Developer (m/f/d).Start: asap
Duration: until 31.12.2020 ++
Location: Remote
Tasks:
We are urgently looking for a Senior Scala/Spark Developer.
Senior Scala / Spark developer will be part of the cross functional SCRUM Team to deliver cloud based business intelligence solution for top insurance company. The team delivers end-2-end solution, starting from data ingestion to data made available for business users or data scientists.
Technology stack - Spark/Databricks, Kafka, Azure Data Lake, Power BI.
As a part of the team, Senior Scala / Spark developer will be paired with other team members and focused on the data processing pipelines, based on Spark and Scala, and enhancement of the framework (written in Scala) which is used to manage and orchestrate data processing pipelines. Contribution to the overall solution architecture, architecture of the Scala framework and other areas of the solution is part of the job.Requirements:
- solid expertise with Scala, mastery of the advanced concepts of the Scala language (e.g. dynamic, programming, reflection)
- good knowledge of software engineering and design patterns, experience with Scala/Spark for data processing
- nice-to-have: Kafka