Beschreibung
Data EngineerLocation: Berlin
Duration: 6 Months
Currently I am working with an International Company that is seeking an experienced Data Engineer for a 6 month project. Onboarding and interviewing will be conducted remotely.
Responsibilities:
• Build enterprise-grade batch and real-time data processing pipelines leveraging the AWS cloud platform, with an emphasis on serverless architectures
• Work with the Data Science and Development teams to design, implement, and facilitate data ingest, extraction, and integration across multiple programming languages (primarily R, Python, and node.js) directly and via REST and GraphQL APIs
• Work with the Data Science and Development teams to facilitate automated data analysis, reporting, and dashboarding solutions in support of client deliverables and licensed SaaS products
• Design and implement automated acceptance and reliability tests based on business requirements and company standards
• Design robust, appropriately normalized schemas for warehousing a wide variety of datasets and determine when SQL vs. NoSQL solutions are preferred
• Collaborate with technical, development, QA, and operational resources
• Leverage traditional and container orchestration technologies to operate data systems
• Leverage shell scripting and Linux system operation skills to assist in the maintenance of and migration from legacy systems
About you:
• Experience with AWS data stack – Redshift, Athena, EMR, Kinesis, DocumentDB, DynamoDB
• Experience with establishing well-organized data lakes
• Experience with Python and R
• Experience setting up and optimizing data warehouses
• Background in data modeling and performance tuning in relational and no-SQL databases
• Experience with data practices (security, data management and governance)
• Experience in operations research, machine learning or optimization
Please note that we can only consider Freelancers (Freiberufler), Unternehmergesellschaft (UG), or candidates with a GmbH and NOT employees from agencies or consulting companies.