Data Engineer – DV Cleared

Location: London / Outer London (hybrid - 3 days on-site)Salary: Up to £90,000 London / £83,000 Outer LondonClearance: Active DV Clearance requiredWe are supporting a leading technology and consulting organisation in the appointment of two Associate Manager Data Engineers to work on high-profile, technically complex programmes. This is an excellent opportunity for experienced Data Engineers who enjoy working across modern data platforms, solving complex technical challenges and taking ownership of delivery within collaborative engineering teams.The RoleYou will be responsible for designing, developing and improving scalable data solutions, working across data engineering, cloud technologies and modern software engineering practices. You will have the opportunity to work with large-scale datasets and contribute to the development of robust data platforms and pipelines.Key responsibilities include:Designing, developing and re-engineering scalable, robust and repeatable data pipelinesBuilding and orchestrating ETL/ELT pipelines using both batch and streaming technologiesWorking with large-scale datasets and developing efficient data transformation processesDefining and maintaining data mappings in line with data modelling principlesBuilding data structures, metadata, dependencies and workload management processesIdentifying and resolving data quality, mapping, database and application issuesConnecting operational systems with analytics and business intelligence platformsDeveloping and maintaining high-quality production code, documentation and automated testingWorking with cloud-based data platforms across AWS, Azure or GCPContributing to the deployment and monitoring of machine learning models where requiredWorking within Agile/Scrum teams and contributing to sprint planning, delivery and technical discussionsProviding technical leadership, supporting team members and contributing to key technical decisionsWorking closely with stakeholders to understand requirements and translate them into effective technical solutionsKey Skills & ExperienceStrong commercial experience in Data EngineeringStrong proficiency in PythonExtensive experience working with AWS, Azure or GCPExperience with data warehousing and data lake architecturesStrong SQL experience, with exposure to NoSQL databasesExperience with distributed computing technologies such as Spark or KinesisUnderstanding of software engineering best practices including CI/CD, TDD and version controlExperience with Docker and/or KubernetesExperience with Infrastructure as Code, ideally Terraform or CloudFormationStrong understanding of data modelling and system architectureExperience working on AI/ML projects would be advantageousPrevious experience providing technical leadership, mentoring or making technical decisionsStrong communication skills, with the ability to explain complex technical concepts to both technical and non-technical stakeholdersExperience working directly with clients or external partnersSecurity ClearanceDue to the nature of the programmes, active DV clearance is essential for these positions. Candidates must be able to maintain the required level of UK security clearance.If you are an experienced Data Engineer looking for a senior opportunity where you can combine hands-on engineering with technical leadership and work on complex, high-impact programmes, we would be keen to hear from you.

#J-18808-Ljbffr