
Data Engineer - Applications
- London
- Permanent
- Full-time
- Data Engineering Accelerators
- Developing Quantexa's libraries for cleansing, parsing and standardising data used in entity resolution
- Finding efficiency/performance improvements through big data testing and building performance tooling
- Owning best practices in entity resolution and network building
- Data Feeds
- Building standardised and reusable code for processing various third party/open source data sets
- Managing an internal data lake for the provision of this data by other teams for testing and analytics
- Owning general best practices for ingesting and processing data to get it ready for use in the Quantexa Platform, including pipelines and scheduling
- Experience designing and building robust, scalable data infrastructure to support high-volume, high-velocity data flows
- Experience in developing and maintaining production-grade ETL and data processing pipelines, with a focus on performance, reliability, and maintainability
- Strong analytical skills, with experience working on real-world, varied datasets to extract insights and improve data quality
- Hands-on experience working with data in cloud-based environments, ideally with distributed systems and modern data platforms
- Familiarity with performance tuning and optimisation techniques for data processing workflows
- A collaborative mindset, with a track record of defining and sharing best practices across teams
- Comfortable working in a fast-paced Agile environment, with a focus on iterative delivery and continuous improvement
- A growth mindset and the drive to thrive within one of the UK's fastest-growing scale-ups
- A strong coding background, ideally in Scala, or in a language such as Java or Python that supports a quick transition to Scala
- Working with big data technologies, ideally Spark, but experience with tools like Airflow or Elasticsearch is also valuable
- Manipulating and transforming data - cleansing, parsing, standardising - to improve data quality and integrity
- Competitive salary and Company Bonus 💰
- Flexible working hours in a hybrid workplace & free access to global WeWork locations & events
- Pension Scheme with a company contribution of 6% (if you contribute 3%)
- 25 days annual leave (with the option to buy up to 5 days) + birthday off! 🌴
- Work from Anywhere Scheme: Spend up to 2 months working outside of your country of employment over a rolling 12-month period
- Family: Enhanced Maternity, Paternity, Adoption, or Shared Parental Leave
- Private Healthcare with AXA
- EAP, Well-being Days, Gym Discounts 🧘
- Free Calm App Subscription #1 app for meditation, relaxation and sleep 🧘♀️
- Workplace Nursery Scheme
- Team's Social Budget & Company-wide Summer & Winter Parties
- Tech & Cycle-to-Work Schemes
- Volunteer Day off
- Dog-friendly Offices