Data Engineer

Data Engineer

Up to £60,000

We are partnering with a growing organisation that is continuing to invest in its data platform, data engineering capabilities and wider technology estate.

As part of this continued investment, the business is looking to appoint a Data Engineer to join its Data & Innovation team. This is an excellent opportunity for an experienced Data Engineer to combine hands-on technical delivery with SQL database expertise, helping to develop and mature a modern Microsoft data platform.

Working closely with stakeholders across technology and the wider business, you will be responsible for developing and maintaining data pipelines, integrating new data sources, optimising data transformation processes and supporting the ongoing performance and reliability of the SQL database estate.

This role would suit a Data Engineer with strong Databricks, SQL and Python/PySpark expertise who enjoys solving technical challenges, improving data platforms and working collaboratively with both technical and non-technical stakeholders.

Key Responsibilities

Design, develop and maintain robust, scalable data pipelines using Databricks, helping to build and shape the wider data platform.

Build and optimise ETL processes that bring together data from a range of sources and make it ready for reporting, analytics and insight.

Create high-quality SQL and Python transformations that are efficient, reliable and built to scale.

Develop and optimise queries, stored procedures and database objects

Contribute to the design and ongoing development of data warehouses, data models and the wider data platform.

Identify opportunities to improve data quality, consistency and reliability while promoting strong database development practices.

Contribute to CI/CD, Git and source control processes, helping to improve automation, deployment and engineering standards.

Skills & Experience

Proven experience working in a Data Engineering role

Hands on Databricks experience, with the ability to develop and support data engineering workloads.

Advanced SQL skills, with confident use of joins, CTEs, window functions and data modelling techniques.

Solid ETL and data integration experience, with an understand...