Beschreibung
The project has the purpose automate processes in the environment and within the NEW BI Foundation.
Task Description
The scope of services includes the following tasks, which are independently performed by the external contractor:
- Automation of Environment, Cloud Services and Software provisioning
- Implementation of automation scripts for built, deploy and configure, typical technology is PowerShell/Terraform or comparable
- Technical consultation in requests regarding provisioning, technology access and how to apply technology to solve project needs
- Creating database connections, configuration of windows Servers and Azure services in order to enable data loads or report implementation
- Detailed documentation of Data load server and hand-over into standard maintenance
Used tool stack: Azure Cloud services, team foundation server (Azure Dev Ops), Azure SQL, Azure SQL DWH, SQL Server Management Studio, Microsoft SQL Server, Azure Data Factory, Azure Data Lake, Azure Analysis Service, Power BI Desktop, Windows server, GitHub, Power Shell
Establish a second fully automated ingest service: DataAsset.Processing.ADF including:
- setup, preparation and deployment existing DataLoad Servers to support this component (ADF runtime + X)
- source drivers
- system IDs/service principals required
- Setup ADF instances for each environment (DEV01/QUA/PRD)
- create access rights auth config
- Review, test, potentially extend Meta Database for JobGroup, stored procedures and all necessary structures
- Repository and Build pipeline for ADF artifacts
- Extension of EDW2 pipeline
- creation for ADF jobs in processing DB
- deploy ADF artifacts
- Documentation and KT to maintenance team
- 3: deploy version from phase 2 via pipeline incl. update of processing DB and initial processing
- 3: design ADF pipeline as generic or generated
- 4: implement ADF according to design in repository with build and CI testing
- 4: deploy ADF artifacts accordingly
- 4: enhance pipeline to deploy accordingly
- 4: delta KT and retro fit of existing infoset
ITHR Group is acting as an Employment Business in relation to this vacancy. ITHR Group is an Equal Opportunities employer; we welcome applicants from all backgrounds.