Data Engineer - Mid Level
TLA
- Liverpool
- £40,000-50,000 per year
- Permanent
- Full-time
- Building and refining data ingestion pipelines for new data assets including vehicle stock data, offers and pricing data, images and more.
- Developing analytics-focused data models in dbt to supply analysts and data scientists with clean, well-structured datasets.
- Implementing and maintaining CI/CD pipelines for our data infrastructure, ensuring automated testing and smooth deployments.
- Participating in code reviews and contributing to team standards for data pipeline development.
- Keeping on top of the latest datasets available within the automotive space and making recommendations about new data sources.
- Supporting and expanding our Microsoft Azure infrastructure, optimising it for data pipeline performance.
- Writing comprehensive data documentation for analytics-focused entities, accelerating your colleagues' understanding of available data.
- 2-4 years of experience building robust data pipelines in a commercial environment or through complex personal projects.
- Strong Python skills including experience with web scraping libraries (scrapy, requests, selenium etc.) and writing production-ready, testable code.
- Advanced SQL skills with experience in query optimisation and data modelling.
- Solid understanding of software engineering principles (SOLID, DRY, design patterns) applied to data engineering.
- Experience with version control (Git) and collaborative development workflows.
- Understanding of CI/CD concepts and experience contributing to automated testing strategies.
- Knowledge of data quality principles including data validation, monitoring, and automated testing frameworks
- Understanding of a framework for modern ELT workflows i.e., dbt, sql-mesh etc.
- Experience working with a cloud platform i.e., AWS, Azure, GCP etc.
- Must be located within a 1-hour commute to Liverpool city centre (non-negotiable due to regular in-office collaboration requirements)
- Experience with both batch and near real-time data pipelines
- Familiarity with Infrastructure as Code (Terraform)
- Experience with dbt and medallion architecture patterns
- Knowledge of Apache Airflow or similar orchestration tools
- Azure cloud platform experience