Back to Job Search

Lead Data Engineer

Job Description

We're looking for an experienced Lead Data Engineer to join a team responsible for all development, maintenance and management of the Physical Data Model (PDM) and databases across multiple cloud-based platforms. 

Your role:

  • Perform updates and changes to the Physical Data Model

  • Designing and building PostgreSQL functions called from the API tier

  • Act as an SME on the Physical Data Model to become a trusted advisor to other teams that have data requirements and translate these into deployable changes

  • Collaborate with the Data Architect to improve the PDM and surrounding processes

  • Support and mentor members of the Physical Data Model team

  • Work with the delivery manager to develop issues in Jira that are refined and detailed enough to be considered ready for development

  • Working closely with the Logical Data Model (LDM) team on collaborative tasks and helping keep both teams aligned

  • Lead data workshops with key stakeholders across business, data and system areas helping to formalise and document requirements. 

  • Own data architecture and design artefacts aligned to CDIO standards.

  • Refining of SQL queries and functions to be more performant

  • Design and implement unit and regression tests on the database

  • Co-own the CI/CD deployment pipeline with senior/lead DAL developer(s) deploying the PDM components as code, using Liqiubase

  • Performing impact analysis on releases to pre-empt any issues these may cause and performing deployments.

  • Ownership of cloud-based data platforms and their performance (e.g. Azure PostgreSQL Flexible Server)

  • Reviews reference data changes for impact to coupled code



Your skills and experience:

  • Experience of designing/working with generic/abstract data models

  • Experience with data modelling tools - preferably SparxEA

  • Experience creating and maintaining data and design artefacts

  • Strong problem-solving abilities in the context of complex data models

  • Strong experience with PostgreSQL

  • Experience creating and tuning complex SQL queries (e.g. self-referencing hierarchies, KVP structures)

  • Strong experience with Database as Code tools – preferably Liquibase

  • Experience with cloud based database platforms – preferably Azure PostgreSQL Flexible Server

  • Experience working in Agile delivery – particularly Scrum & SAFe.