Beschreibung
Role: Freelance Data Engineer (Spark, AWS, Python, SQL)Location: Remote / Frankfurt
Length: Until EOY
Industry: Transportation
Development services for the establishment and further development of a data analysis platform. A classic DWH application is migrated to a data lake in the AWS Cloud.
The platform is implemented on the basis of current standard technologies (AWS Serverless and Hadoop) and architectures and can be expanded as required and scalable as required.
The role:
• Methodical support of the client in the requested area of responsibility
• Configuring and Using AWS Services
• Analysis of problems in the mentioned context as well as development and evaluation of options for action to solve the problems according to best practices of the market and taking into account the customer situation
• Participation in project-related meetings to clarify technical details as well as the project-related ceremonies in the Scrum team
• Creation and evaluation of functional specifications
Target Requirements:
• Extensive experience (at least 3 years) with Spark
• Extensive experience (at least 3 years in different projects) in the programming language Python and the associated frameworks.
• Extensive experience (at least 3 years) with SQL
• Extensive cloud experience (at least 3 years) with AWS and/or Azure
• Extensive experience (at least 3 years) with data warehouse/data lake
Nice to have requirements:
• Experience with the Scala programming language
• Proven experience in working in an agile environment (e.B Scrum) based on reference projects
• Strong experience in agile requirements engineering (e.B. user journeys, EPICs, features, user stories, user story mapping) in at least three large projects within the last three years
• Extensive problem-solving/work organization know-how, demonstrable from the last three projects
• Outstanding skills of written and oral communication with all direct and indirect project participants
• Experience with DevOps