Data Engineer

Data Engineer

6 Month Contract

Location: London (Onsite 4 days a week)

Rate: £700 - £800 per day (INSIDE IR35)

Skills: Python, Azure, Kubernetes, Apache Airflow, Apache Spark, DV Clearance

We are looking to recruit a DV Cleared Data Engineer for a leading technology consultancy. This will be joining an established defence programme requiring additional engineering support across an existing data platform.

You will be responsible for building, maintaining and improving new and existing data pipelines within a secure MoD environment.

Due to the nature of the work you will be required to work on site in London 4 days a week.

Key Responsibilities

Build and maintain robust data pipelines using Python

Work across Azure environments on the low side

Support data engineering workloads within Kubernetes environments on the high side

Develop and maintain workflows using Apache Airflow

Work with Apache Spark for large-scale data processing

Support the ongoing development and improvement of established data pipelines

Help ensure data remains within MoD-owned infrastructure in line with data governance requirements

Work within an existing long-running programme requiring additional delivery capacity

Essential Skills

Active DV Clearance

Strong Python data engineering experience

Experience with Azure

Strong knowledge of Kubernetes

Experience with Apache Airflow

Experience with Apache Spark

Strong background building and maintaining production data pipelines

Desirable

Previous experience working within a Palantir environment

Experience delivering data solutions within secure defence or government environments

AMRT1_UKTJ

...