Beschreibung
Are you an experienced Data Engineer with an interest in working on a huge Data Lake project? Would you like to be involved in one of the latest IoT projects for the Automotive sector?
If the answer to the above is YES then Eurobase would like to hear from you.
The role
- Design and implement data solutions for large-scale data architectures and applications
- Work hands-on with Big Data tools and frameworks required to provide requested capabilities
- Implement and manage ETL processes, data transformations, data flows and service APIs
- Manage the Data Lake and its key Big Data technologies
- Define and implement data ingestion, retention, lineage and access policies
- Define and implement data service API management and usage policies
What you need
- Proficient understanding of distributed and Cloud computing principles and technologies
- Experience with integration of data from multiple data sources
- Experience in data modelling, data management, and data governance
- Experience with NoSQL databases, such as HBase, Cassandra, InfluxDB, others
- Proficiency with SQL & NoSQL query interfaces/languages; SparkSQL and KSQL a plus
- Good knowledge of ETL techniques and frameworks, such as PowerCenter, Flume, Nifi, Sqoop - Good knowledge of Big Data tools from the Hadoop Eco-System (HBase, Pig, Hive, etc.)
- Strong programming skills in Java or Python - Experience with Spark and Kafka (eg, for processing of IoT sensor and machine data)
- Experience with building stream-processing systems based on Kafka- and Spark-Streaming
- Experience with management of Apache Hadoop cluster and services (ZooKeeper, Ranger, etc.)
- Experience with Microsoft Azure Cloud Computing Platform and Services
- Good understanding of Lambda Architecture
This role also has the chance for remote work once settled into the project. Please send your CV for an immediate review.