
Data Engineer
- London
- Permanent
- Full-time
- As a big data consultant, you'll translate functional requirements into technical requirements
- Design and develop high performing and stable end-to-end big data applications to perform complex processing of batch and real-time massive volumes of data in a multi-tenancy cloud environment
- As a big data Engineer, you will develop and implement tools for data acquisition, extraction, transformation, management, and manipulation of large and complex data sets
- You'll be involved in all aspects of development - design, development, build, deployment, monitoring and operations
- Research and experiment with emerging technologies and industry trends with a view to bringing business value through early adoption
- A minimum Bachelor's degree is required in Computer Science or in a directly related IT discipline
- At least 1-2 years' experience with handling big data projects using SQL and Python
- You can demonstrate tangible experience using AWS and Databricks
- Excellent communications skills: an ability to communicate with impact, ensuring complex information is articulated in a meaningful way to wide and varied audiences
- A passion for technology and a strong interest in pursuing a specialist careers path as a Big Data Engineer
- A strong understanding of key Python concepts related to data engineering is needed as a foundation on which to build (e.g. Pandas, numpy, Python file handling, JSON)
- You possess solid understanding of AWS cloud environments, including S3, LAMBDA, RDS, AWS CDK or Terraform, Dynamo DB
- Flexibility regarding local business travelling