Beschreibung
We are looking for a Senior Data Engineer (m/f/d) for our customer to work on a remote basis.The Senior Data Engineer is responsible for developing, maintaining, and evaluating the data infrastructure and models for the company´s data scientists and BI developers.
You develop and maintain ETLs of raw data from various source systems into analytics environments to support data discovery, analytical model development, and BI needs.
Weitere Rahmendaten
Einsatzart: Freelance
Auslastung: 100 %
Branche:
Your tasks
- Support data scientists and BI developers on data and analytics initiatives and ensure optimal data delivery architecture is consistent throughout ongoing projects
- Translate business, analytics, and BI requirements into scalable data architecture and infrastructure
- Develop and execute the collection, storing, processing, modeling, and analyzing of multiple sources of data; design and develop scalable ETL routines
- Apply extensive knowledge on databases and best engineering practices: handling and logging errors, system monitoring, building human-fault-tolerant pipelines, addressing continuous integration, knowledge of database administration, data cleaning
- Enable and run data pipelines, performing testing and validation to ensure data accuracy and data verification
- Resolve data quality issues
- Work with cross-functional business, analytics, and IT teams to deliver maintainable, secure, and multi-faceted use cases
- Develop and document best practices for data engineering within the company
Must have competences
- Professional data engineering experience in building reliable and scalable data platforms and pipelines
- Experience working with raw as well as prepared structured and unstructured data; holistic understanding of different kinds of data, volume, real-time, and stream processing
- Strong experience with distributed systems, e.g. Hadoop, Spark, Kafka
- Proficiency with Python and Scala; Java an advantage
- SQL skills and database and data warehouse understanding
- In-depth experience with cloud providers: AWS, Azure, or Google, where AWS preferred: S3, Lambda, Glue, Redshift, SQS, CloudWatch, API Gateway, Sagemaker, Greengrass, Kinesis
- Experience in CI/CD environments
- NoSQL, document database, data vault knowledge, and unstructured datastore skills a bonus
- Ability to work as an ML Engineer or develop into that direction preferred
Über uns
Es ist unser Anspruch als Business- und IT-Beratung, erstklassige Leistung und höchste Qualität für unsere Kunden zu erbringen. Daher steht Q für Qualität und _PERIOR, abgeleitet aus „superior“, unterstreicht, dass wir alles dafür tun, erstklassige Ergebnisse für unsere Kunden zu liefern. Wir bieten Partnerunternehmen und Freelancern (m/w/d) umfassende Perspektiven innerhalb unserer eigenen Projekte und unterstützen unsere Kunden als langjähriger Rahmenvertragspartner bei der Besetzung von Projektvakanzen – zeitnah und direkt.
Wir freuen uns auf Ihre Kontaktaufnahme!
Ihr direkter Ansprechpartner bei Q_PERIOR
Mirza Tahirovic
Telefon:
E-Mail: