BI Data Enginner
£38k - £40k
Cardiff (Remote)
Our client is a leading name in the financial world and is looking for BI / Data Engineer to join one of their talented, modern remote teams. They have the freedom of a two-year-old startup, with the backing of a FTSE 100 company.
Working with the latest technologies and platforms:
-
AWS
-
RedShift
-
MongoDB
-
Athena
-
Glue
-
EMR
-
Data Streams
-
Analytics toolsets
As an experienced Data Engineer, you will have a deep understanding of data technologies, strong software engineering skills, a deep interest in data analytics along with a growing passion for Machine Learning.
Working as a key part of the Data Team, the role involves creating data solutions to process data at scale using both batch and real-time scenarios, on a wide range of data driven projects to support our continued growth.
Key Responsibilities:
-
Implement workflows to ingest data into our Data Warehouse and Data Lake from a variety of data sources.
-
Work closely with Data Architecture, Business Intelligence, Data Science and IT Delivery Teams to design, develop and maintain highly scalable data solutions and pipelines.
-
Identify and document requirements from Business Intelligence and Analytics Teams turning them into data assets for consumption against stated requirements.
-
Develop and refine datasets and processes recommending ways to improve both the reliability and underlying quality of our data.
What we’re looking for in you:
-
Data engineering experience ideally using AWS
-
Hands on experience with AWS Athena, Redshift and underlying Data Lake concepts.
-
Expert knowledge of both SQL and NoSQL database systems and concepts.
-
Experienced with optimised storage file formats (parquet, avro etc.).
-
Proficient at building big data infrastructure, ingestion and modelling pipelines.
-
Strong ETL skills, fluent in using AWS Glue, AWS EMR / Spark, NIFI and Airflow
-
Coding experience with Python, Java, Spark-SQL, R.
-
Data modelling skills, able to model and visualise data requirements to aid technical design.
-
Experience consuming and integrating with 3rd Party APi’s.
Nice to have:
-
Relevant cloud certification.
-
Prior experience with Apache Hudi / Delta Lake concepts.
-
Experience designing and building scalable API’s to host Machine Learning Models.
-
Previous financial services experience
-
Experienced with Agile software development
Remote working:
-
We want the best talent, no matter where you’re based. We have teams all over the UK building something special.
-
You will be given all the tools needed to jump straight into the team.