Beschreibung
I'm recruiting for a Data Engineer - AWS for a global agile tech consultancy. Further details below
- Location: Fully Remote - may be required to travel to Glasgow, Scotland - this will be confirmed by the client in the interview
- Day Rate: £.00 for 6 months
- Inside IR35
- Start date: ASAP
Data Engineer Qualifications
- Experience with SQL
- Experience with data ingestion practices and tools such as Informatica, StreamSets or Apache NiFi
- Experience of BI tools and Data processing frameworks such as Apache Spark - preferably using Python (PySpark) or Scala
- Experience with Data visualisation technologies
- Experience in writing data processing jobs in notebook environments such as Zeppelin, Jupyter
- Knowledge of HDFS, Object store and the various serialisation formats such as Parquet, ORC, Avro, Protobuf etc.
- Experience with architecting/designing data solutions
- Knowledge of CI/CD in relation to the data engineering pipelines
- Comment - this capability in D & A is not very mature at the moment
- Unix and Active Directory (Kerberos particularly)
- AWS experience
If you feel you have the skills please submit your CV and I will be in touch regarding the short interview process
Xpertise acts as an employment agency