Data Engineer

Beschreibung

Freelance Senior Data Engineer

Glocomms is currently working in partnership with a Global IT Integrator who are looking for a Senior Data Engineer with a deep interest in big data and technologies such as Spark and Scala.

Skills & Experience
•Experience of data loading, either scripting or using ETL technologies.
•Sensitivity to the security and lifecycle management requirements of personal financial data.
•Worked extensively of Hive, Spark, Kafka, Hbase
•Knowledge of working with the Hortonworks Data Platform
•Experience of both batch and real time
•A good understanding of UNIX systems, especially Linux.
•An understanding of file formats including csv, XML and JSON, as well as the related standards and technologies.
•The ability to develop reliable, maintainable, efficient code in Java and Python
•3+ years of experience in Data pipelines written in Spark (with Java or Scala) and collecting data from Kafka and delivering to Hive or Hbase
•The ability and willingness to create and maintain concise, accurate, readable, relevant documentation on our wiki (we use Confluence.

Location: Hamburg
Rate: Negotiable.
Length of Contract: 6 Months
Hours per week: 40

If you are interested in this position please send your CV to