Beschreibung
Big Data Developer is being sought by Templeton & Partners to join one of our international clients in the Rhein-Main-Area in Germany.
We're looking for a Big Data Developer with solid internal understanding basics of Hadoop stack HDFS, MapReduce, Yarn, Hive and solid internal understanding basics of Spark.
Some of your key activities will include:
- Design and implement data pipeline which includes, data transformations and key performance indicator calculations, implement data product logic, stage the data for final output.
- Design and implement data products application development as needed by the project.
- Document design artefacts and check-in code artefacts to the Merck code repository.
- Code review of the team members and approval.
- Participate in daily scrum as and when needed.
- Design artefacts review and approval.
- Participate in Requirement analysis, Architecture, design and development workshops.
- Design and implement data ingestion pipeline which includes, data ingestion, cleansing, transformation, staging.
Mandatory Skills:
- SQL, Scala Must have
- Python, Java Good to have
- Sqoop, Oozie
- Secondary
- HBase, Kafka
- Streaming BigData
- Apache Atlas
- Rest API, Building rest based webservices, microservices
- Docker