
Principal Data Engineer
- Derbyshire
- Permanent
- Full-time
- Help define and take the lead on the deployment of modern data engineering solutions across the Microsoft Azure ecosystem
- Build, automate, and manage scalable ETL/ELT data pipelines using Microsoft Fabric and Azure Synapse
- Lead the adoption and implementation of Microsoft Fabric as the core of our unified data platform
- Integrate diverse data sources across on-premise systems, cloud platforms, and third-party applications using Azure Integration Services (Logic Apps, API Management, Event Grid)
- Drive best practices in data ingestion, transformation, governance, and lineage
- Support AI Engineers in building Retrieval-Augmented Generation (RAG) pipelines, including embedding generation, document chunking, and vector database integration
- Optimize data pipelines that feed LLM-based agents, ensuring high-performance retrieval and timely access to knowledge
- Collaborate with colleagues in Data & Analytics Team to ensure reliable, timely access to trusted data
- Mentor junior engineers and support continuous improvement across the team
- Ensure solutions meet security, compliance, and performance standards
- Lead performance tuning, troubleshooting, and root cause analysis of critical data processes
- Contribute to the overall data strategy, architecture roadmap, and technology stack decisions
- Experience of designing and implementation of an Azure analytical platform including Azure Integration Services, Azure Synapse Analytics, Microsoft Fabric, Azure Databricks and Logic Apps
- Experience of working with senior stakeholders to articulate the strategy, objectives and benefits of a central enterprise cloud data platform
- Experience of DevOps to manage workload
- Experience of coaching and mentoring data engineers to achieve successful outcomes
- Understanding of data sciences tools and techniques combined with an understanding of a range of data sources
- Familiarity with AI-focused data engineering, including RAG systems, vector databases, embedding pipelines, and semantic indexing
- A proven record of collaboration with colleagues and stakeholders
- Process mapping and supporting documentation production
- Test plan formulation and managing through to resolution
- Ability to communicate and collaboration with multiple stakeholders across the business and within Breedon Technology Services
- High level of technical proficiency in designing, implementing and maintaining a quality service
- Research and evaluation of technological developments
- Ability to analyse and troubleshoot potential issues within the platform
- Ability to identify creative solutions to overcome problems
- Ability to impart knowledge and support the development of team members
- Ability to support AI workflows by designing high-performance retrieval pipelines and working with AI engineering teams
- Company Pension
- Discount Scheme
- Enhanced Maternity, Paternity & Adoptions Scheme
- Free on-site Parking
- Health & Wellbeing Initiatives
- Life Assurance
- Share Save Scheme
- Volunteering Policy
- Holiday Buy Scheme