(SC cleared) Data Engineer

Bristol Area
Permanent
Full-time

1 month ago

Job Description:Methods Analytics (MA) is recruiting for a Data Engineer to join our team a permanent basis.This role will be mainly remote but require flexibility to travel to Bristol.What You'll Be Doing as a Data Engineer:

Design and architect modern data solutions that align with business objectives and technical requirements
Design and implement advanced ETL/ELT pipelines using Python, SQL, and Apache Airflow
Build highly scalable and performant data solutions leveraging cloud platforms and technologies
Develop complex data models to handle enterprise-level analytical needs
Make critical technical decisions on tools, frameworks, and approaches for complex data challenges
Optimise large-scale data processing systems for performance and cost-efficiency
Implement robust data quality frameworks and monitoring solutions
Evaluate new technologies to enhance our data engineering capabilities
Collaborate with stakeholders to translate business requirements into technical specifications
Present technical solutions to leadership and non-technical stakeholders
Contribute to the development of the Methods Analytics Engineering Practice by participating in our internal community of practice

Your Impact:

Enable business leaders to make informed decisions with confidence through timely, accurate data insights
Drive adoption of modern data architectures and platforms
Deliver seamless data solutions that enhance user experience
Elevate the technical capabilities of the entire data engineering team
Help cultivate a data-driven culture within the organisation
Establish technical standards and patterns that ensure quality and maintainability

Requirements:

Experience in SQL Server Integration Services (SSIS)
Good experience with ETL - SSIS, SSRS, T-SQL (On-prem/Cloud)

Strong proficiency in SQL and Python for handling complex data problems
Hands-on experience with Apache Spark (PySpark or Spark SQL)
Experience with the Azure data stack
Knowledge of workflow orchestration tools like Apache Airflow
Experience with containerisation technologies like Docker
Proficiency in dimensional modelling techniques
Experience with CI/CD pipelines for data solutions
Experience implementing and advocating for test-driven development methodologies in data pipeline workflows, including unit testing, integration testing, and data quality validation frameworks
Strong communication skills for translating complex technical concepts
Track record of successful project delivery in a technical leadership capacity

You may also have some of the desirable skills and experience:

Experience designing and implementing data mesh or data fabric architectures
Knowledge of cost optimisation strategies for cloud data platforms
Experience with data quality frameworks and implementation
Understanding of data lineage and metadata management
Experience with technical project management
Experience with data visualisation tools like Power BI or Apache Superset
Experience with other cloud data platforms like AWS, GCP or Oracle
Experience with modern unified data platforms like Databricks or Microsoft Fabric
Experience with Kubernetes for container orchestration
Understanding of streaming technologies (Apache Kafka, event-based architectures)
Software engineering background with SOLID principles understanding
Experience with high-performance, large-scale data systems
Knowledge of recent innovations in AI/ML and GenAI
Defence or Public Sector experience
Consultant experience

Security Clearance:UKSV (United Kingdom Security Vetting) clearance is required for this role, with Security Check (SC) as the minimum standard.Our Hiring ProcessAt Methods Analytics, we believe in a transparent hiring process. Here's what you can expect:1. Internal Application Review2. Initial Phone Screen3. Technical Interview4. Pair Programming Exercise5. Final Interview6. OfferBenefits:Working at MAMethods Analytics (MA) exists to improve society by helping people make better decisions with data. Combining passionate people, sector-specific insight, and technical excellence to provide our customers an end-to-end data service.We use a collaborative, creative and user centric approach to data to do good and solve difficult problems. Ensuring that our outputs are transparent, robust, and transformative. We value discussion and debate as part of our approach. We will question assumptions, ambition, and process - but do so with respect and humility.We relish difficult problems, and overcome them with innovation, creativity, and technical freedom to help us design optimum solutions. Ethics, privacy, and quality are at the heart of our work, and we will not sacrifice these for outcomes.We treat data with respect and use it only for the right purpose. Our people are positive, dedicated, and relentless. Data is a vast topic, but we strive for interactions that are engaging, informative and fun in equal measure. But maintain a steely focus on outcomes and delivering quality products for our customers.We are passionate about our people; we want out colleagues to develop the things they are good at and enjoy.By joining us you can expect

Autonomy to develop and grow your skills and experience
Be part of exciting project work that is making a difference in society
Strong, inspiring, and thought-provoking leadership
A supportive and collaborative environment

As well as this, we offer:

Development access to Pluralsight and LinkedIn Learning
Wellness 24/7 Confidential employee assistance programme
Social - office parties, pizza Friday and commitment to charitable causes
Time off - 25 days of annual leave a year, plus bank holidays, with the option to buy 5 extra days each year
Volunteering - 2 paid days per year to volunteer in our local communities or within a charity organisation
Pension Salary Exchange Scheme with 4% employer contribution and 5% employee contribution
Discretionary Company Bonus based on company and individual performance
Life Assurance of 4 times base salary
Private Medical Insurance which is non-contributory (spouse and dependants included)
Worldwide Travel Insurance which is non-contributory (spouse and dependants included)

Methods Business and Digital Technology

Apply Now