Senior Data Integration Engineer

BGL Group

  • Shoreditch, East London
  • Permanent
  • Full-time
  • 1 month ago
Our purpose is to make great financial decision making a breeze for everyone, and that purpose drives us every day.It’s why we’re on a mission to create an automated quoting engine, with the simplest of experiences, wrapped in a brand everyone loves!We change lives by making it simple to switch and save money and that’s why good things happen when you meerkat.We’d love you to be part of our journey.The Senior Data Integration Engineer bridges the gap between data processors, consumers, and Data Platform teams. This role ensures Data Products like Knowledge Graphs, LLM applications, Self-Service tools, Data Lineage and Quality tooling integrate seamlessly, and access relevant information curated in the most suitable and cost-effective manner.Collaborating with data, technology, and business stakeholders, the role provides expert guidance on improving data quality, availability, and utilisation across Compare the Market (CtM). By enhancing system robustness, and driving optimisation, the Sr. Data Integration Engineer supports enterprise data governance while fostering innovation.Everyone is welcome.We have a culture of creativity. We approach our work passionately, improve constantly and celebrate our wins at every turn. We are an inclusive workplace and our employees are comfortable bringing their authentic, whole selves to work. Everyone is welcome. Be you.This means we’re excited to hear from people with a range of skills, experiences and ideas. We don’t expect you to tick all the boxes, but would love to hear what makes you great for this role.Some of the great things you’ll be doing:
  • Act as the Subject Matter Expert (SME) for CtM’s data systems, ensuring seamless integration of Data Products (e.g., Knowledge Graphs, LLM applications, Data Lakehouse platforms (e.g., Databricks), Self-Service tools, Data Lineage, and Quality Tooling) with the Data Platform and other systems.
  • Help develop and maintain integration roadmaps and designs that align with enterprise architectural decisions.
  • Support the design and implementation of data pipelines and workflows that enable reliable and efficient data access.
  • Maintain & document comprehensive knowledge of CtM’s data systems, tools, and platforms, serving as the go-to expert for integration-related questions.
  • Act as a bridge between technical and business teams, translating requirements into actionable integration tasks and providing guidance on the efficient use of data systems and tools.
  • Propose strategies to deliver value early while maintaining quality and mitigating risks.
  • Ensure integration solutions are scalable, cost-effective, and future-proof.
  • Ensure integration efforts comply with data governance standards, regulatory frameworks, and organisational security and privacy policies, while also driving improvements in data quality and utilisation.
  • Work across teams, including architecture, engineering, data science and machine learning, reporting, knowledge graph, and business stakeholders, to align integration efforts with enterprise standards, best practices, and strategic goals
  • Partner with the Data & Enterprise Architecture team to align integration efforts with architectural standards.
  • Work in partnership with the Data Platform Capabilities teams to ensure data flows and sources are optimised for performance, scalability, and stakeholder needs.
  • Collaborate with Staff & Principal Engineers to reduce complexity and standardise tools, processes, and practices across the domain.
  • Continuously explore and implement innovative solutions for data integration, reducing complexity, improving scalability and performance, and enhancing data accessibility.
What we’d like to see from you:
  • Expert in data integration, ETL processes, and data modelling.
  • Hands-on expertise with relational and non-relational databases.
  • Familiarity with data governance practices, regulatory, and data privacy law compliance such as GDPR or PECR.
  • Proficiency in using cloud services (AWS, Google Cloud) for data storage, processing, and analytics solutions.
  • Effective communication skills to articulate complex data processes to both technical and non-technical stakeholders
  • Familiarity with the implications of AI and machine learning in data architecture.
  • Experience with lakehouse platforms such as Databricks, including orchestration and optimisation of large-scale data workflows, is advantageous.
There’s something for everyone.We’re a place of opportunity. You’ll have the tools and autonomy to drive your own career, supported by a team of amazingly talented people.And then there’s our benefits. For us, it’s not just about a competitive salary and hybrid working, we care about what matters to you. From a generous holiday allowance and private healthcare to an electric car scheme and paid development, wellbeing and CSR days, we’ve pretty much got you covered!#LI-HL1

BGL Group