Data Engineer

£40k - £50k
Cardiff (remote)

Our client is a leading name in the financial world and is looking for BI / Data Engineer to join one of their talented, modern remote teams. They have the freedom of a two-year-old startup, with the backing of a FTSE 100 company.

Working with the latest technologies and platforms:

 

  • AWS

  • RedShift

  • MongoDB

  • Athena

  • Glue

  • EMR

  • Data Streams

  • Analytics toolsets


As an experienced Data Engineer, you will have a deep understanding of data technologies, strong software engineering skills, a deep interest in data analytics along with a growing passion for Machine Learning.

Working as a key part of the Data Team, the role involves creating data solutions to process data at scale using both batch and real-time scenarios, on a wide range of data driven projects to support our continued growth.

 

Key Responsibilities

  • Implement workflows to ingest data into our Data Warehouse and Data Lake from a variety of data sources.

  • Work closely with Data Architecture, Business Intelligence, Data Science and IT Delivery Teams to design, develop and maintain highly scalable data solutions and pipelines.

  • Identify and document requirements from Business Intelligence and Analytics Teams turning them into data assets for consumption against stated requirements.

  • Develop and refine datasets and processes recommending ways to improve both the reliability and underlying quality of our data.

 

 

What we’re looking for in you

 

  • 3+ years of relevant data engineering experience ideally using AWS

  • Hands on experience with AWS Athena, Redshift and underlying Data Lake concepts.

  • Expert knowledge of both SQL and NoSQL database systems and concepts.

  • Experienced with optimised storage file formats (parquet, avro etc.).

  • Proficient at building big data infrastructure, ingestion and modelling pipelines.

  • Strong ETL skills, fluent in using AWS Glue, AWS EMR / Spark, NIFI and Airflow

  • Coding experience with Python, Java, Spark-SQL, R.

  • Data modelling skills, able to model and visualise data requirements to aid technical design. 

  • Experience consuming and integrating with 3rd Party APi’s.

 


Nice to have

 

  • Relevant cloud certification.

  • Prior experience with Apache Hudi / Delta Lake concepts.

  • Experience designing and building scalable API’s to host Machine Learning Models.

  • Previous financial services experience

  • Experienced with Agile software development

 


Remote working

We want the best talent, no matter where you’re based. We have teams all over the UK building something special.
You will be given all the tools needed to jump straight into the team.

Apply to job
Upload CV
Upload supported file (Max 15MB)

© Hanover Recruitment 2020

info@hanrec.com

 +44 (0)203 145 1266

  • LinkedIn
  • YouTube
  • Facebook
  • Twitter