Lead DevOps Engineer (Data)

With Intelligence

  • London
  • Permanent
  • Full-time
  • 1 month ago
Job Description:AboutWe are seeking a Senior DevOps Engineer to take full ownership of our data platform infrastructure. You'll play a key role in scaling and supporting our data systems, which leverage a modern AWS stack and Snowflake. This is a high-impact role with direct influence over reliability, observability, and the DevOps maturity of our data engineering function.Key Responsibilities
  • Platform Ownership
  • Own and manage the data platform infrastructure built on AWS services (EventBridge, Lambda, EC2, MWAA, S3).
  • Oversee deployment and monitoring of Snowflake, and support its integration into the broader data ecosystem.
  • Infrastructure and System Reliability
  • Ensure platform reliability, availability, and scalability across environments.
  • Design and maintain robust monitoring, alerting, and observability frameworks to reduce MTTR and improve visibility.
  • Lead and manage initiatives related to data lineage, platform health, and alert hygiene.
  • CI/CD and Automation
  • Enhance and expand our CI/CD processes using Bitbucket pipelines.
  • Drive consistent rollout of DevOps practices across all data engineering squads.
  • Champion infrastructure as code (IaC) principles using tools like Terraform or CloudFormation.
  • Cross-Team Collaboration
  • Work cross-functionally with data engineering squads to identify platform pain points, inefficiencies, and areas for improvement.
  • Translate ambiguous platform challenges into structured initiatives and deliver value iteratively.
  • Security & Networking
  • Manage VPCs, security groups, IAM roles, and cross-account networking and permissions within AWS.
  • Support secure integration with Microsoft PowerApps and other third-party services where applicable.
Requirements:Essential Skills & Experience
  • Proven experience owning and operating production data platforms within AWS.
  • Strong understanding of AWS core services: EventBridge, Lambda, EC2, S3, and MWAA (Managed Workflows for Apache Airflow).
  • Experience with infrastructure reliability, observability tooling, and platform automation.
  • Solid experience with CI/CD pipelines, preferably Bitbucket Pipelines.
  • Familiarity with Snowflake administration and deployment practices.
  • Comfortable working through ambiguity and in cross-functional, collaborative teams.
  • Experience with infrastructure-as-code tools such as Terraform or CloudFormation.
Desirable (Not Required)
  • Python scripting experience (for automation or lightweight tooling).
  • Exposure to MLOps tooling and workflows.
  • Familiarity with Power Platform (especially Microsoft PowerApps) in a data integration context.
  • Understanding of data lineage, governance, and operational monitoring in modern data stacks.
Benefits:
  • 24 days annual leave rising to 29 days
  • Enhanced parental leave
  • Medicash (Health Cash Plans)
  • Wellness Days
  • Flexible Fridays (Opportunity to finish early)
  • Birthday day off
  • Employee assistance program
  • Travel loan scheme
  • Charity days
  • Breakfast provided
  • Social Events throughout the year
  • Hybrid Working
Our Company:With Intelligence is based at One London Wall, London EC2Y 5EA. We offer amazing benefits, free breakfast daily and drinks provided all day, every day. We actively encourage social networks that oversee activities from sports, book reading to rock climbing, that you are free to join.As part of our company, you will enjoy the benefits of an open plan office and working with a social and energetic team. With Intelligence provides exclusive editorial, research, data and events for senior executives within the asset management industry. These include hedge funds, private credit, private equity, real estate and traditional asset management, and our editorial brands are seen as market leaders in providing asset manager sales and IR execs with the actionable information they require to help them raise and retain assets. To maintain and grow our position in the market we need to continue to hire highly motivated, thoughtful and to ensure our subscribers are getting the exclusive intelligence they need first, and most comprehensively, through our range of services. If you are interested so far in what you have read, please apply, we look forward to hearing from you.We are an Equal Opportunity Employer. Our policy is not to discriminate against any applicant or employee based on actual or perceived race, age, sex or gender (including pregnancy), marital status, national origin, ancestry, citizenship status, mental or physical disability, religion, creed, colour, sexual orientation, gender identity or expression (including transgender status), veteran status, genetic information, or any other characteristic protected by applicable law.

With Intelligence