Beschreibung
Spark Scala developer - Freelance - ASAP (m/w/d)Skills:
• Experience in building and optimizing ‘big data’ pipelines and data lake.
• Hands on with big data tools: Hadoop, Map reduce, Spark, PySpark, hive, Kafka, AWS
S3.
• Knowledge with stream-processing systems: Spark-Streaming using Kafka.
• Hands on experience in programming language: Scala, python, Java, groovy
• Should have experienced to handle large dataset
• Should be hands on experience in spark optimization
• Hands on with relational SQL and NoSQL databases, like oracle, Exasol, DB2 and
HBase, Cassandra.
• Experience with data pipeline and workflow management tools: oozie, Data factory,
Airflow
• Good knowledge on CI/CD concepts using Jenkins, git, bitbucket etc.
• Experience with cloud services in Azure or AWS.
• Should be experienced in software development life cycle principles, practice, and
disciplines
• Understand and Interpret client requirements into software architecture and design
• Strong critical thinking, decision making, and problem-solving skills.
• Reviewing source code and providing feedback relative to best used practices,
performance improvements and code optimization etc.
Good to Have:
• Basic knowledge on Alteryx tools.
• Atlassian Tools, JIRA, Confluence
• Agile Scrum methodology.
Soft Skills:
• Process Oriented
• Excellent verbal/written communication skills, including communicating technical issues
to non-technical audiences and presentation skills .
• Experience with team management