Senior Data Engineer - Databricks (6 Month Contractor)

MUFG Investor Services

  • London
  • Contract
  • Full-time
  • 2 hours ago
Company DescriptionExperience something Brilliantly Different with a career at MUFG Investor Services.Who are we? In a nutshell, MUFG Investor Services is part of the Mitsubishi UFJ Financial Group, and we partner with over 480 loyal global investment firms to provide them with administration, asset services, banking and fund financing.We're in 14 global locations and provide an exceptional hub of Brilliantly Different talent to thrive.#LI-HybridJob DescriptionWe are looking for a skilled Data Engineer with substantial experience to design, develop, and maintain scalable data pipelines and data solutions using Databricks. You'll collaborate closely with cross-functional teams to ensure data quality, availability, and efficiency to support analytics and business intelligence.You Will:
  • Design and implement scalable data architectures using Databricks Unity Catalog, Delta Lake, and Apache Spark
  • Develop and maintain complex ETL/ELT pipelines processing terabytes of data daily
  • Architect medallion architecture (Bronze, Silver, Gold) data lakehouses with optimal performance patterns
  • Implement real-time and batch data processing solutions using Structured Streaming and Delta Live Tables
  • Design data mesh architectures with proper data governance and lineage tracking
  • Optimize Spark jobs for cost efficiency and performance, including cluster auto-scaling and resource management
  • Implement advanced Delta Lake features including time travel, vacuum operations, and Z-ordering
  • Build robust data quality frameworks with automated testing and monitoring
  • Design and implement CI/CD pipelines for data workflows using Databricks Asset Bundles or similar tools
  • Develop custom solutions using Databricks APIs and integrate with external systems
#LI-HybridQualificationsYou Have:
  • A Bachelor's degree in computer science, or a related field.
  • 10+ years of experience in data engineering, including designing and deploying production-quality data pipelines and ETL/ELT solutions.
  • A Databricks Certified Professional Data Engineer certification
  • Proficiency in Python, PySpark and SQL.
  • Strong hands-on experience with cloud services such as AWS (Glue, Lambda, Redshift, S3).
  • Experience with data governance and management platforms (e.g., AWS Sagemaker Unified Studio and Unity Catalog.
  • Experience with data migration projects and legacy system modernization
  • Familiarity with containerization and orchestration technologies (Docker, Kubernetes) is a plus.
Additional InformationWhat's in it for you to join MUFG Investor Services?Take a look at our careers site and you'll find everything you'd expect working with one of the fastest-growing businesses at one of the world's largest financial groups. Now take another look. Because it's how we defy expectations that really defines us. You'll feel that difference in all kinds of ways. Our vibrant CULTURE. Connected team. Love of innovation, laser client focus.So, why settle for the ordinary? Apply now for your next Brilliantly Different opportunity.We thank all candidates for applying; however, only those proceeding to the interview stage will be contacted.MUFG is an equal opportunity employer

MUFG Investor Services