Beschreibung
For my client I´m looking for a Kafka Software Engineer/ Data Engineer (m/f/d), who can support him asap.Responsibilities:
- Develop new functionalities especially for the core data capabilities provided by the Global Data Platform (GDP), which are:
- Real Time Ingestion Service
- Data Governance Solution
- Knowledge Graph
- Data Supermarket (UI for data consumers based on the knowledge graph or ingested data to search and consume data sets)
- Understand and explain advantages and disadvantages of the proposed solutions to internal and external stakeholders
- Participate in Scrum ceremonies e.g., daily standup, Sprint review
- Evaluate new technologies in the field of data engineering, processing, and management
- Contribute to improve the Big Data software stack and define the final production environment
- Look for opportunities to improve performance, reliability, and automation
- Resolve incidents and change requests
- Support and interact with data consumers and data engineers
- Write technical documentation, announcements, blog posts, and best practices
Requirements:
- Experience in Java applications development (Spring/Spring Boot) following a microservices architecture
- Extensive experience working with Kafka and Confluent platform (Kafka Connect, KSQL, and schema registry) is a must
- Experience building and optimizing "big data" pipelines and architectures particularly Event-driven systems and Kafka based workflows
- Deep experience with containerized applications and container orchestration (Docker, Kubernetes)
- Experience with a CI/CD process & tools
- Hands-on experience with Azure cloud services is preferred
- Experience with Data Governance Frameworks (e.g. Informatica) and principles is a plus
- Knowledge of front-end development (Angular) is a plus
Project details:
- Start: asap
- End: 31.12.2021
- Location: remote
- Language: Englisch
Point of contact: Nadine Adler, , Mobil: