Data Engineer
Prevail
- London
- Permanent
- Full-time
- Receiving large datasets and transforming them to enable our mission teams to rapidly exploit the data.
- Identifying improvements to our current data processes and implementing solutions.
- Implementing data flows to connect operational systems, data for analytics, and business intelligence systems
- Creation and development of data pipelines
- Documenting source-to-target mappings
- Re-engineering manual data flows to enable scaling and repeatable use
- Support the build of data streaming systems
- Build and maintain ETL scripts and pipelines and code to ensure the ETL process performs optimally and ensures data is accurate and easy to use
- Develop business intelligence reports that can be used for multiple audiences
- Build accessible data for analysis
- Automate data processing tasks and workflows
- Collaborate with cross functional teams to advocate for high-quality data solutions
- building, modelling, and maintaining data pipelines
- with a range of Amazon Web Service products and technologies such as EC2, S3, Lambda, and Redshift
- designing data infrastructure to support modelling and data analytics
- as an AWS Solutions Architect or Lead, or similar
- Strong Python experience or other object oriented or a functional programming language such as Java, Scala, C#, or R
- Data warehousing – building operation ETL data pipelines across several sources, and constructing relation and dimensional data models
- If you have previous exposure to geospatial data, that would be advantageous but is not a requirement for the position.
- Excellent communication and collaboration skills