Beschreibung
Tasks:- Adaptation / integration of new data sources -
Development of models for the evaluation of anomalies and data quality
Development of Big Data ETL pipelines based on common open source frameworks
- Development and transition of new functionalities including complete documentation and corresponding test coverage
- Adjustment of existing functionalities to changed environments including complete documentation of corresponding test coverage
- performance tuning
- adaptation & creation of tableau dashboards
Must:
Big Data experience
Python
PySpark
ETL
Tableau
Start: asap