BI Data Enginner

£38k - £40k

Cardiff (Remote)

Our client is a leading name in the financial world and is looking for BI / Data Engineer to join one of their talented, modern remote teams. They have the freedom of a two-year-old startup, with the backing of a FTSE 100 company.

Working with the latest technologies and platforms:

• AWS

• RedShift

• MongoDB

• Athena

• Glue

• EMR

• Data Streams

• Analytics toolsets

As an experienced Data Engineer, you will have a deep understanding of data technologies, strong software engineering skills, a deep interest in data analytics along with a growing passion for Machine Learning.

Working as a key part of the Data Team, the role involves creating data solutions to process data at scale using both batch and real-time scenarios, on a wide range of data driven projects to support our continued growth.

​

Key Responsibilities:

​

• Implement workflows to ingest data into our Data Warehouse and Data Lake from a variety of data sources.

• Work closely with Data Architecture, Business Intelligence, Data Science and IT Delivery Teams to design, develop and maintain highly scalable data solutions and pipelines.

• Identify and document requirements from Business Intelligence and Analytics Teams turning them into data assets for consumption against stated requirements.

• Develop and refine datasets and processes recommending ways to improve both the reliability and underlying quality of our data.

​

​

What we’re looking for in you:

​

• Data engineering experience ideally using AWS

• Hands on experience with AWS Athena, Redshift and underlying Data Lake concepts.

• Expert knowledge of both SQL and NoSQL database systems and concepts.

• Experienced with optimised storage file formats (parquet, avro etc.).

• Proficient at building big data infrastructure, ingestion and modelling pipelines.

• Strong ETL skills, fluent in using AWS Glue, AWS EMR / Spark, NIFI and Airflow

• Coding experience with Python, Java, Spark-SQL, R.

• Data modelling skills, able to model and visualise data requirements to aid technical design. 

• Experience consuming and integrating with 3rd Party APi’s.

​

Nice to have:

​

• Relevant cloud certification.

• Prior experience with Apache Hudi / Delta Lake concepts.

• Experience designing and building scalable API’s to host Machine Learning Models.

• Previous financial services experience

• Experienced with Agile software development

​

​

Remote working:

​

• We want the best talent, no matter where you’re based. We have teams all over the UK building something special.

• You will be given all the tools needed to jump straight into the team.