Principal Data Engineer

Mirai Tech Recruitment

  • Derby
  • Permanent
  • Full-time
  • 1 month ago
Principal Data EngineerAre you passionate about data and eager to play a pivotal role in a major digital transformation? We’re seeking a talented and experienced Azure Data Engineer to join a leading FTSE 250 organisation as they embark on an exciting journey to become a truly data-led business.The Opportunity:This is an opportunity to shape the future of data management capabilities within a large and complex organisation. As they move towards becoming a data-driven business, you’ll be instrumental in designing, implementing, and maintaining their Azure data platform. This platform will be the foundation for data scientists, data engineers, and analysts across the business to become self-serving, unlocking the power of data to drive innovation and strategic decision-making.This is a senior, hands-on role focused on designing and delivering scalable data solutions using cutting-edge Azure technologies. You’ll be at the forefront of modern data engineering, working with Azure Synapse Analytics, Microsoft Fabric, Azure Databricks, and Logic Apps to build a robust and scalable platform.Key Responsibilities:
  • Help define and take the lead on the deployment of modern data engineering solutions across the Microsoft Azure ecosystem.
  • Build, automate, and manage scalable ETL/ELT data pipelines using Microsoft Fabric and Azure Synapse.
  • Lead the adoption and implementation of Microsoft Fabric as the core of our unified data platform.
  • Integrate diverse data sources across on-premise systems, cloud platforms, and third-party applications using Azure Integration Services (Logic Apps, API Management, Event Grid).
  • Drive best practices in data ingestion, transformation, governance, and lineage.
  • Support AI Engineers in building Retrieval-Augmented Generation (RAG) pipelines, including embedding generation, document chunking, and vector database integration.
  • Optimise data pipelines that feed LLM-based agents, ensuring high-performance retrieval and timely access to knowledge.
  • Collaborate with colleagues in the Data & Analytics Team to ensure reliable, timely access to trusted data.
  • Mentor junior engineers and support continuous improvement across the team.
  • Ensure solutions meet security, compliance, and performance standards.
  • Lead performance tuning, troubleshooting, and root cause analysis of critical data processes.
  • Contribute to the overall data strategy, architecture roadmap, and technology stack decisions.
Skills, Knowledge & Expertise:
  • Experience in designing and implementation of an Azure analytical platform including Azure Integration Services, Azure Synapse Analytics, Microsoft Fabric, Azure Databricks and Logic Apps.
  • Experience of working with senior stakeholders to articulate the strategy, objectives and benefits of a central enterprise cloud data platform.
  • Experience of DevOps to manage workload.
  • Experience of coaching and mentoring data engineers to achieve successful outcomes.
  • Understanding of data sciences tools and techniques combined with an understanding of a range of data sources.
  • Familiarity with AI-focused data engineering, including RAG systems, vector databases, embedding pipelines, and semantic indexing.
  • A proven record of collaboration with colleagues and stakeholders.
  • Process mapping and supporting documentation production.
  • Test plan formulation and managing through to resolution.
Essential Skills:
  • Strong communication and collaboration skills, with the ability to engage with multiple stakeholders.
  • High level of technical proficiency in designing, implementing, and maintaining a quality service.
  • Strong research and evaluation skills regarding technological developments.
  • Ability to analyse and troubleshoot potential issues within the platform.
  • Ability to identify creative solutions to overcome problems.
  • Ability to impart knowledge and support the development of team members.
  • Ability to support AI workflows by designing high-performance retrieval pipelines and working with AI engineering teams.
Benefits:
  • Company Pension
  • Discount Scheme
  • Enhanced Maternity, Paternity & Adoptions Scheme
  • Free on-site Parking
  • Health & Wellbeing Initiatives
  • Life Assurance
  • Share Save Scheme
  • Volunteering Policy
  • Holiday Buy Scheme
Mirai believes in the power of diversity and the importance of an inclusive culture. It welcomes applications from individuals of all backgrounds, understanding that a range of perspectives strengthens both its team and the teams of its partners. This is just one of the ways that they’re taking positive action to shape a collaborative and diverse future in the workplace.

Mirai Tech Recruitment