Data Engineer – DV Cleared

Location: London / Outer London (hybrid - 3 days on-site)

Salary: Up to £90,000 London / £83,000 Outer London

Clearance: Active DV Clearance required

We are supporting a leading technology and consulting organisation in the appointment of two Associate Manager Data Engineers to work on high-profile, technically complex programmes. This is an excellent opportunity for experienced Data Engineers who enjoy working across modern data platforms, solving complex technical challenges and taking ownership of delivery within collaborative engineering teams.

The Role

You will be responsible for designing, developing and improving scalable data solutions, working across data engineering, cloud technologies and modern software engineering practices. You will have the opportunity to work with large-scale datasets and contribute to the development of robust data platforms and pipelines.

Key responsibilities include:

• Designing, developing and re-engineering scalable, robust and repeatable data pipelines
• Building and orchestrating ETL/ELT pipelines using both batch and streaming technologies
• Working with large-scale datasets and developing efficient data transformation processes
• Defining and maintaining data mappings in line with data modelling principles
• Building data structures, metadata, dependencies and workload management processes
• Identifying and resolving data quality, mapping, database and application issues
• Connecting operational systems with analytics and business intelligence platforms
• Developing and maintaining high-quality production code, documentation and automated testing
• Working with cloud-based data platforms across AWS, Azure or GCP
• Contributing to the deployment and monitoring of machine learning models where required
• Working within Agile/Scrum teams and contributing to sprint planning, delivery and technical discussions
• Providing technical leadership, supporting team members and contributing to key technical decisions
• Working closely with stakeholders to understand requirements and translate them into effective technical solutions

Key Skills & Experience

• Strong commercial experience in Data Engineering
• Strong proficiency in Python
• Extensive experience working with AWS, Azure or GCP
• Experience with data warehousing and data lake architectures
• Strong SQL experience, with exposure to NoSQL databases
• Experience with distributed computing technologies such as Spark or Kinesis
• Understanding of software engineering best practices including CI/CD, TDD and version control
• Experience with Docker and/or Kubernetes
• Experience with Infrastructure as Code, ideally Terraform or CloudFormation
• Strong understanding of data modelling and system architecture
• Experience working on AI/ML projects would be advantageous
• Previous experience providing technical leadership, mentoring or making technical decisions
• Strong communication skills, with the ability to explain complex technical concepts to both technical and non-technical stakeholders
• Experience working directly with clients or external partners

Security Clearance

Due to the nature of the programmes, active DV clearance is essential for these positions. Candidates must be able to maintain the required level of UK security clearance.

If you are an experienced Data Engineer looking for a senior opportunity where you can combine hands-on engineering with technical leadership and work on complex, high-impact programmes, we would be keen to hear from you.