Beschreibung
Hi William,I have a requirement for a Freelance Data Engineer to join a data team working within a market-leading international marketplace company.
You will join a cross functional, agile data team working with the latest modern technologies. This team are responsible for building the data hub for a leading real estate platform with a focus on delivering business data models, data performance and data ingestion topics.
Are you currently available for new projects?
B2B / Freelance Contract
Role: Data Engineer
Engagement: Full-time freelance contract
Project Length: 6 months + extensions
Work Location: 100% remote
Start Date: November / December 2023
Project Language: English
Please reply with your CV, availability and day rate if you are interested in this position and we can schedule a call to discuss it further.
---
Role:
A Senior Data Engineer is required to join the data team of an online marketplace company, which are currently experiencing a company-wide technology transformation. The primary focus of the company is the unification of two global platforms into one unified tech stack and platform. The data team are a key contributor to these efforts, working with high-volume heterogeneous data.
Tasks:
• Build upon the current data technology stack (AWS, Snowflake, Airflow)
• Design and develop data integration pipelines which collect, store and transform data assets used in production.
• Set up data ingestion frameworks which are used by other product teams
• Maintain a data catalog of company data assets so that stakeholders who need access can find, comprehend, and rely on it.
• Working on data lineage, data transformation, data modelling, data storage, data access and data quality.
• Upkeep and operation of the data infrastructure, including data quality assurance, documentation, cloud infrastructure orchestration, and operational efficiency.
• Building and enhancing data products (transformations, dashboards, logical data warehouse models, etc.)
Key Skills
• Python
• SQL
• Snowflake
• Airflow / Airflow Astronomer
• AWS Services (SNS, Lambda, S3)
• DBT
• Datadog
• Strong data modelling skills