Beschreibung
Hadoop Expert / Data Engineer (m/w)We are an IT service provider for projects, expert leasing and personnel procurement. We work with around 1000 employees for well-known and renowned enterprises. For one of our clients in Wuppertal we are currently looking for an Interim Hadoop Expert oder Data Engineer with sufficient Hadoop knowlegde (f/m).
Aufgabenbeschreibung:
- Architecture of data integration chains from source systems like Salesforce, SAP-BW and relational data bases into Hadoop
- Design of efficient data structures in the Hadoop ecosystem, esp. for Hive and Spark
- Collaboration with data scientists in design and implementation of analytics solutions
- Track record of designing data structures for Hive and Spark in the context of
- Knowledge of ETL tools, esp. Talend
- Stream analytics: Kafka, Storm
- Ideally experiences with IoT applications
- Further plus: Experiences with time series databases, HBase
For data science support in addition:
- Track record of experiences in PySpark applications for data analytics
- Experiences in machine learning, esp. sci-kit learn, Tensorflow
- Further plus: Scala with Spark
- Experiences in the usage of machine data for predictions
- Further plus: Tableau Desktop/Tableau Server
For Azure integration in addition:
- Architecture and setup of Hive and Spark clusters based on HDInsight
- Integration with corporate IT (VPN connectivity, Active Directory)
- Alignment with IT security and legal regarding compliance, data protection and
Job site: Wuppertal/remote
Start: October 2017
Duration: 3 Month+
Workload: Full-Time
If this sounds interesting to you, we look forward to receiving your CV including your hourly rate.