Senior Test Engineer - Data Platforms

Overview

We are seeking an experienced Lead Test Engineer to take full ownership of the testing approach for data pipelines and data products within a modern Azure data platform. This role is hands-on: you will design, implement, and execute test strategies across the stack, working alongside data engineers, BI developers, and architects to ensure robust, high-quality, and reliable solutions.

The platform leverages Azure Databricks, Azure Data Factory, Azure Data Lake Storage, and Power BI. As the sole test specialist, you will embed quality engineering into every stage of delivery, acting as the authority on data testing practices.

Responsibilities

• Test Ownership & Strategy
  • Define and own the overall testing strategy for data pipelines, models, and reporting solutions
  • Establish automated testing frameworks and ensure they are embedded in delivery processes
  • Act as the subject matter expert for data testing, advising engineers and stakeholders
• Hands-on Testing
  • Design and execute test cases across data ingestion, transformation, storage, and presentation layers
  • Implement automated validation for data pipelines (Databricks notebooks, ADF workflows, ADLS layers)
  • Validate Power BI dashboards and reports for data accuracy, performance, and usability
  • Perform exploratory, regression, and performance testing as required
• Quality Assurance
  • Set up data quality checks, reconciliation processes, and monitoring
  • Ensure compliance with data security and governance requirements
  • Integrate test execution into CI/CD pipelines to enforce quality gates
• Collaboration
  • Work closely with data engineers to embed testing at source
  • Partner with architects and product owners to define acceptance criteria
  • Represent testing considerations in sprint planning and delivery reviews

Requirements

Essential Skills & Experience

• Strong track record as a Test Engineer in data engineering or analytics projects
• Expertise in testing Azure data services: Databricks, ADF, ADLS, and Power BI
• Proficiency in SQL and data profiling for test design and validation
• Hands-on experience with test automation frameworks for data (e.g., Python/Pyspark, Great Expectations, Pytest, dbt tests, or equivalent)
• Practical knowledge of CI/CD integration (Azure DevOps, GitHub Actions, or similar)
• Excellent problem-solving skills and the ability to work independently as the sole testing specialist on a delivery team

Desirable Skills

• Familiarity with public sector delivery frameworks and regulated data environments
• Experience of data performance testing and monitoring
• Knowledge of Agile delivery methods and DevOps practices
• Exposure to Test-Driven Development (TDD) and Behaviour-Driven Development (BDD) practices
• ISTQB or similar testing certification

Benefits

UBDS Group offers a range of professional development opportunities and benefits, with a culture focused on innovation and collaboration. Employee benefits include training options, private medical cover, discretionary bonus, generous holiday allowance, electric vehicle leasing, contributed pension, and death in service cover. We are an equal opportunities employer and do not discriminate on the grounds of gender, sexual orientation, marital or civil partner status, pregnancy or maternity, gender reassignment, race, colour, nationality, ethnic or national origin, religion or belief, disability or age.

About UBDS Group

At UBDS Group our mission is to support entrepreneurs who are setting new standards with technology solutions across cloud services, cybersecurity, data and AI, ensuring that every investment advances our commitment to innovation and creating impactful solutions for organisations and society.

Equal Opportunities

We are an equal opportunities employer and do not discriminate on the grounds of gender, sexual orientation, marital or civil partner status, pregnancy or maternity, gender reassignment, race, colour, nationality, ethnic or national origin, religion or belief, disability or age.