Beschreibung
Big Data Engineer | Dusseldorf | 6 months | Hasoop, Spark Core, Spark Sql, Impala/Hive
Square One are currently looking for multiple Big Data Engineers for one of our clients based out of Dusseldorf starting in the next couple of weeks on a 6 month project.
The succesful candidate will have the following experience and skill set:
8+ years of overall IT experience including 2+ years in big data technologies (Hadoop, Spark core, Spark SQL, Impala/Hive, HBase, Oozie, Sqoop, Java/Scala/Python).
3+ years of exp in Java prior to the big data projects.
Data Warehouse modernization experience on Hadoop cluster is a MUST.
Experience in working with large volumes of data (Terabytes), analyze the data structures and design in Hadoop cluster effectively.
Open to work on Proof of Concepts, learn/operate and innovate new ideas.
Experience in data migration from relational databases to Hadoop HDFS
Must have good understanding of compression and file formats like Parquet, ORC and sequence.
Application performance tuning and troubleshooting
Participate in analysis of data stores and help with data analytics
Ensure solutions developed adhere to security and data entitlements
Translate, load and present disparate data sets in multiple formats/sources including JSON
Skillset Requirements
8+ years of overall IT experience including 2+ years in big data technologies (Hadoop, Spark, Impala/Hive, HBase, Oozie, Sqoop, Java/Scala/python).
Data Warehouse modernization experience on Hadoop data lake is a MUST.
3+ years of hands on development experience in JAVA/Scala/Python, prior to the big data projects.
Must have experience in ingesting data from multiple sources and integrating them together in Hadoop.
Experience in feeding data to appliance based data warehouse systems such as Teradata, Netezza, Greenplum, etc is a plus.
Unix Shell Scripting experience is required.
NoSQL experience is a Big Plus.
Knowledge on Banking or financial domain is a plus.
If you are interested, please forward your CV in confidence and get in touch with Ben Wrigley.
Big Data Engineer | Dusseldorf | 6 months | Hasoop, Spark Core, Spark Sql, Impala/Hive
Notwithstanding any guidelines given to years of experience sought, we will consider candidates from outside this range if they can demonstrate the necessary competencies.
Square One is acting as both an employment agency and an employment business, and is an equal opportunities recruitment business. Square One embraces diversity and will treat everyone equally: Please see our website for our full diversity statement.