Big Data Engineer

Beschreibung

Job Title: Big Data Engineer
Location: Fully Remote
Rate: 50-65 per hour euro per hour
Job Type: Contract - 6 months initially

An exciting opportunity is now available with one of our biggest customer engagement platform clients!

They are currently looking for a Big Data Engineer with strong experience of Python, Kafka Spark.

Responsibilities

• You will be working in a cross-discipline delivery team focused on servicing our many core data products
• Strong programming and architectural experience, ideally in Python, but we are open to other experience
• Gather and process raw data at scale using frameworks such as Hadoop, Spark, and Kafka
• Experience with data visualisation, i.e Grafana or Tableau
• Rest APis & Kubernetes
• Shape the technical direction of our data aggregation, information extraction, visualisation and entity matching system
• Strong programming and architectural experience, ideally in Python, but we are open to other experience
• You feel comfortable working with legacy systems and evolving them
• Team player who likes to help others and to keep the focus on getting things done
• You are excited to learn about new technologies and to share your knowledge about them with others

What Would Make You a Perfect Fit:

• • Strong understanding of big data processing technologies like Apache Spark, MapReduce, Hive, Clickhouse, MongoDB, Postgres
  • Experience with Classification, Machine Learning and/or Entity Matching (or at least the willingness to familiarise yourself with it)
  • Experience in workflow management systems such as Airflow or Luigi
  • Experience with both batch- and streaming based data processing
  • Experience with data visualisation, for example in Grafana or Tableau
  • Experience building REST-APIs
  • Experience with Kubernetes

Contact Information
If you are interested in this opportunity, please apply now with your updated CV in Microsoft Word/PDF format to