Beschreibung
Our Client is currently in the market for a Data Engineer for their Global retail project.
Your Responsibilities
* Design scalable architectures for Real Time and batch data processing
* Successfully partner with data scientists to support building advanced data products based on Big Data technology and implement their models
* Successfully partner with system operators to design data generation and provisioning architectures.
* Be responsible for Data Management/Engineering on our Hadoop-based data platform working in the fields: data ingestion management, data architecture and Datamodelling, data quality and data accessibility as well as data governance
* Research opportunities for data acquisition and new uses for existing data
* Help to build a healthy, sustainable and scalable data infrastructure
* Leverage data infrastructure and lead best practices sharing with engineers and analysts and business partners across the company
Your Profile
* Passionate about building scalable products using Big Data
* Ideally already worked on creating a Real Time data infrastructure for Big Data processing
* Experience within the Hadoop ecosystem and Linux environments
* 3+ years of related work experience
* A background with NoSQL databases (eg Cassandra, HBase, MongoDB) as well as SQL databases
* Experience with Big Data technologies (eg Map-reduce, Spark, Storm, Hive, Impala, Pig, Kafka, Elastic Search) and workflow scheduling (eg Jenkins, Oozie)
* Proficiency with at least one programming language such as Java, Scala or Python and experience with large-scale software systems and architectures.
* Desire to quickly learn new technologies and adopt tools that fit a problem best
* Being hands-on and resourceful
* Able to work autonomously but also operate as part of a strong, cohesive team
* Team-spirit and strong personality
* Strong communication skills
* Fluent English