Beschreibung
For our client we are looking for an experienced Apache NiFi DeveloperYour main task is to support the client in developing some real-time NiFi integration tools to pull data from 3rd party suppliers via REST APIs.
The REST APIs are specific to the vendors so each has their own specific design; however, there is an expectation to be able to leverage the same code across the multiple solutions.
Tasks:
• Develop real-time NiFi integration tools
• Support other developers in the team build their skills with NiFi/Kafka
• Show good development practices around unit and integration testing and demonstrate effective documentation
Requirements:
• Strong development skills in Apache NiFi
• Experience with either Hortonworks and/or Cloudera Data Flow tools
• Experience in developing production NiFi workflows integrating data from third party REST API sources into Hadoop data sources such as Hive/HBase
• Familiar with JSON schemas and calling REST APIs from tools such as ‘curl’ or Java/Scala/Python libraries
Nice to have:
• familiarity and experience in building Kafka workflows
• experience with Spark and Spark streaming within the Hadoop environment
• familiarity with Python/PySpark
• skilled in using Git and experience with CI/CD paradigms
Project details:
• Start: April 2021
• Duration: 6 months (+ option to extend)
• Workload: 5 days per week
• Location: 100% remote, some on site work in Germany may be required post COVID19
• Languages: Fluency in English, German language skills beneficial
Telephone interview slots with our client can be arranged at short notice with a decision immediately thereafter.