Beschreibung
Dear Freelancer,for my client I'm looking for a Big Data Solution Engineer. This includes the following responsibilities:
- Rollout the Allianz Global Data Platform (GDP) to our customers and support the adaption of the technical services and the data capabilities
- Design the solutions of the complete use-case pipelines, from data ingestion to data processing, software deployment and feedback loop
- Understand and be able to explain advantages and disadvantages of the proposed solutions to internal and external stakeholders
- Build and maintain data driven applications on top of GDP
- Define and apply best practices based on our platform
- Contribute to improve the GDP stack and to define the final production environment
- Keep up with trends and evolving technology in the big data and analytics world
- Identify opportunities to improve performance, reliability and automation
- Write technical documentation, announcements, and blog posts about our platform on internal channels
Technical Skills
Our platform is a diverse product consisting of several technologies. This characteristic should be reflected in our cross functional team of individuals who have a deep technical expertise in their core areas and at the same time are able to work also outside of their core area. We encourage to contribute your individual strengths and personality to the team and give you the room to develop some new skills and experiences. The following technical skills are required for this particular position:
Data Engineering (using the tools to build data-driven solutions)
- Theoretical and practical competency in running big data workloads in production at scale
- Familiar with data engineering patterns (Ingestion, Transformation, Storage, Consumption etc.)
- Event-based systems (deep knowledge on the Kafka confluent stack)
- Relational databases (e.g. Postgres)
- Graph databases (e.g. Neo4j, Stardog)
- Cloud storage (Azure Datalake or AWS S3 with EMR)
- Distributed systems (e.g. Spark)
- Knowledge graph (e.g. Stardog)
Software Development
- Proficiency in at least one programming language (we have components written in Python, Angular, Clojure, Scala, Elm, etc.)
- Software engineering (micro services, design patterns, version control, automated testing, concurrent programming etc.)
- Continuous integration, deployment, and delivery
General IT Skills
- Advanced experience with Linux
- Containerization and container orchestration (Docker & Kubernetes)
- General understanding of IT infrastructure, orchestration and IT security principles, especially on enterprise level
Other Skills
- Bachelor (BSc), Master (MSc) or equivalent experience in a technical field (for example, Computer Science, Engineering...)
- DevOps mindset (you build it, you run it; taking responsibility for your work)
- Willingness and ability to learn new technologies and tools
- Team player open to work in an agile environment
- Fluent English (written and spoken) is a must, other languages (e.g. German, French, Italian, etc.) are a plus
- Capability of result oriented communication with people from different departments with different skill sets
Project details:
- Start: asap
- Duration: 31.12.2021 (extension possible)
- Location: Remote
- Project language: English must have, german nice to have
- Workload: 100%
If you are interested, please send me the following things:
- CV
- Hourly rate
- Availability
Best regards,
Kevin Negret