Full-Stack Developer2 days remote/HybridYou will be working within a talented team of analysis/consultants to help deliver analytical solutions and consultancy projects to clients across a range of sectors (travel, manufacturing, microfinance, engineering, services etc.). Typical responsibilities will include:
Manage both scheduled and ad hoc data harvesting processes.
Write efficient regular expressions to extract data from raw HTML, JSON, and XML.
Clean and validate harvested data using automated processes.
Troubleshoot and resolve complex data processing issues.
Maintain and enhance existing data pipelines and services.
Improve automation for data processing and delivery.
Core Requirements:
Solid understanding of HTTP protocols and request/response architecture.
Proficiency in writing Regular Expressions for data extraction.
Working knowledge of Python, SQL, and either C# or Java.
Strong problem-solving and debugging skills.
Effective communication skills for understanding project needs and working with the team.
Advantageous:
Experience with automated data harvesting using Python, C#, or Java.
Familiarity with front-end technologies (JavaScript, React).
Experience with cloud platforms like AWS or GCP (especially BigQuery).
Exposure to Big Data tools such as Elasticsearch.
Background in the travel industry.
Knowledge of GitHub and version control best practices.
Tech Stack & Tools
Cloud: AWS, GCP (BigQuery)
Languages: Python, Java, C#
Data: SQL, JSON, XML, ElasticSearch
Other: HTTP, Regular Expressions, GitHub
Please send me copies of your CV if you meet the requirements