BI Data Enginner

£38k - £40k
Cardiff (Remote)

Our client is a leading name in the financial world and is looking for BI / Data Engineer to join one of their talented, modern remote teams. They have the freedom of a two-year-old startup, with the backing of a FTSE 100 company.

 

Working with the latest technologies and platforms:

  • AWS

  • RedShift

  • MongoDB

  • Athena

  • Glue

  • EMR

  • Data Streams

  • Analytics toolsets

 

As an experienced Data Engineer, you will have a deep understanding of data technologies, strong software engineering skills, a deep interest in data analytics along with a growing passion for Machine Learning.

Working as a key part of the Data Team, the role involves creating data solutions to process data at scale using both batch and real-time scenarios, on a wide range of data driven projects to support our continued growth.

 

Key Responsibilities:

  • Implement workflows to ingest data into our Data Warehouse and Data Lake from a variety of data sources.

  • Work closely with Data Architecture, Business Intelligence, Data Science and IT Delivery Teams to design, develop and maintain highly scalable data solutions and pipelines.

  • Identify and document requirements from Business Intelligence and Analytics Teams turning them into data assets for consumption against stated requirements.

  • Develop and refine datasets and processes recommending ways to improve both the reliability and underlying quality of our data.

What we’re looking for in you:

  • Data engineering experience ideally using AWS

  • Hands on experience with AWS Athena, Redshift and underlying Data Lake concepts.

  • Expert knowledge of both SQL and NoSQL database systems and concepts.

  • Experienced with optimised storage file formats (parquet, avro etc.).

  • Proficient at building big data infrastructure, ingestion and modelling pipelines.

  • Strong ETL skills, fluent in using AWS Glue, AWS EMR / Spark, NIFI and Airflow

  • Coding experience with Python, Java, Spark-SQL, R.

  • Data modelling skills, able to model and visualise data requirements to aid technical design. 

  • Experience consuming and integrating with 3rd Party APi’s.

 

Nice to have:

  • Relevant cloud certification.

  • Prior experience with Apache Hudi / Delta Lake concepts.

  • Experience designing and building scalable API’s to host Machine Learning Models.

  • Previous financial services experience

  • Experienced with Agile software development

Remote working:

  • We want the best talent, no matter where you’re based. We have teams all over the UK building something special.

  • You will be given all the tools needed to jump straight into the team.

Apply to job
Upload CV
Upload supported file (Max 15MB)

© Hanover Recruitment 2020

info@hanrec.com

 +44 (0)203 145 1266

  • LinkedIn
  • YouTube
  • Facebook
  • Twitter