Data Analyst/Program Manager

Cpl Group

  • London
  • £420 per day
  • Contract
  • Full-time
  • 13 days ago
Role: Software Dev EngineerDuration: 6 Month ContractLocation: LondonRate: Up to £420 a dayJob summaryThis project consists of transforming our AWS Redshift cluster (UDM) from a production-level system used across multiple orgs to a reporting-level system used within CF only. It consists of several tasks that focus on i) reducing the surface area, ii) deprecating and migrating core pipelines off of UDM and iii) upgrading the cluster configuration based on the new needs. In addition, third-party vendor is also expect to address company-wide mandates related to the Digital Markets Act (DMA) and security initiativesDeliverablesUDM Migration1. Offboard external teams2. Offboard internal teams' production use cases3. Migrate key pipelines off of UDM4. Migrate derived datasets off of UDM5. Clean up the cluster6. Update cluster configuration7. Automate cluster management and maintenanceDMA and Security1. Move UDM to private subnet2. DMA Tagging of Customer Behavior DatasetsSkillsCandidates are expected to have 2+ years of experience in 5 out of the 6 following domains.
  • Knowledge of distributed systems as it pertains to data storage and computing
  • Experience with data modeling, warehousing and building ETL pipelines
  • Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
  • Experience programming with at least one programming language such as C++, C#, Java, Python, Golang, PowerShell, Ruby
  • Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
  • Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)

Cpl Group