
Consultant - Senior Consultant, Data Engineer, AI & Data, Defence & Security
- England
- Permanent
- Full-time
- Apply data engineering tools, integration frameworks, and query engines to create high quality, standardised data for downstream use cases, such as for AI and reporting.
- Design and implement high quality data pipelines and data stores, coordinating efforts with other developers and engineers.
- Bring innovation and novel approaches to solve challenging data engineering problems.
- Architect and implement for scale and complexity that provide value across many teams and consumers.
- Develop logical and physical data modeling and governance strategy, establishing standards across teams.
- Ingesting, transforming, enriching, and integrating data from diverse sources into well-structured information assets.
- Distributed computing techniques like parallel processing, streaming, batch workflow orchestration that enable handling large data volumes.
- ETL, data pipelines, and automated workflows for moving and processing data.
- Optimising data systems for performance, scalability, reliability, and monitoring.
- Information security including access controls, encryption, anonymity for sensitive data assets.
- Data governance, including metadata management, data quality, and lineage tracking.
- End-to-end development experience with data pipelines, ETL processes, workflow orchestration - using core concepts that apply across tech stacks.
- Working with diverse data sources and types - batch, streaming, real-time, and unstructured.
- Systems thinking and architectural design skills for building scalable, high-performance data solutions.
- Data modelling, warehouse design, database optimization knowledge - with samples of logical/physical models that reflect proficiency.
- Deploying, and managing distributed data systems.
- Ability to monitor, troubleshoot, and tune these systems for reliability and performance.
- Coding experience that demonstrates modularity, reusability, and efficiency - across languages.
- Understanding full development lifecycle, SDLC concepts, version control, CI/CD pipelines.
- Knowledge of data security, governance, metadata management, master data principles.
- Communication skills, ability to understand business requirements and translate to technical data solutions.