Freelance Big Date Solution Engineer 100% Remote

Vertragsart:
Vor Ort
Start:
07/2021
Dauer:
keine Angabe
Von:
Progressive IT
Ort:
München
Eingestellt:
11.06.2021
Land:
flag_no Deutschland
Projekt-ID:
2132636


Dear Freelancer,

for my client I'm looking for a Big Data Solution Engineer. This includes the following responsibilities:
  • Rollout the Allianz Global Data Platform (GDP) to our customers and support the adaption of the technical services and the data capabilities
  • Design the solutions of the complete use-case pipelines, from data ingestion to data processing, software deployment and feedback loop
  • Understand and be able to explain advantages and disadvantages of the proposed solutions to internal and external stakeholders
  • Build and maintain data driven applications on top of GDP
  • Define and apply best practices based on our platform
  • Contribute to improve the GDP stack and to define the final production environment
  • Keep up with trends and evolving technology in the big data and analytics world
  • Identify opportunities to improve performance, reliability and automation
  • Write technical documentation, announcements, and blog posts about our platform on internal channels


Technical Skills

Our platform is a diverse product consisting of several technologies. This characteristic should be reflected in our cross functional team of individuals who have a deep technical expertise in their core areas and at the same time are able to work also outside of their core area. We encourage to contribute your individual strengths and personality to the team and give you the room to develop some new skills and experiences. The following technical skills are required for this particular position:

Data Engineering (using the tools to build data-driven solutions)
  • Theoretical and practical competency in running big data workloads in production at scale
  • Familiar with data engineering patterns (Ingestion, Transformation, Storage, Consumption etc.)
  • Event-based systems (deep knowledge on the Kafka confluent stack)
  • Relational databases (e.g. Postgres)
  • Graph databases (e.g. Neo4j, Stardog)
  • Cloud storage (Azure Datalake or AWS S3 with EMR)
  • Distributed systems (e.g. Spark)
  • Knowledge graph (e.g. Stardog)


Software Development
  • Proficiency in at least one programming language (we have components written in Python, Angular, Clojure, Scala, Elm, etc.)
  • Software engineering (micro services, design patterns, version control, automated testing, concurrent programming etc.)
  • Continuous integration, deployment, and delivery


General IT Skills
  • Advanced experience with Linux
  • Containerization and container orchestration (Docker & Kubernetes)
  • General understanding of IT infrastructure, orchestration and IT security principles, especially on enterprise level


Other Skills
  • Bachelor (BSc), Master (MSc) or equivalent experience in a technical field (for example, Computer Science, Engineering...)
  • DevOps mindset (you build it, you run it; taking responsibility for your work)
  • Willingness and ability to learn new technologies and tools
  • Team player open to work in an agile environment
  • Fluent English (written and spoken) is a must, other languages (e.g. German, French, Italian, etc.) are a plus
  • Capability of result oriented communication with people from different departments with different skill sets


Project details:
  • Start: asap
  • Duration: 31.12.2021 (extension possible)
  • Location: Remote
  • Project language: English must have, german nice to have
  • Workload: 100%


If you are interested, please send me the following things:
  • CV
  • Hourly rate
  • Availability


Best regards,
Kevin Negret
k.negret(at)progressive.de