Senior Data Engineer

Location: Portsmouth customer site – 3 days p/week on siteSalary: Up to £90k DoE plus bonusClearance: Active SC (British passport required)To apply, email: We’re working with a leading technology consultancy delivering secure, mission critical digital capabilities across Secure Sector programmes. They’re looking for an experienced Databricks Data Engineer to design and build scalable, resilient data applications that support operational users, analytics platforms, and AI-enabled capabilities.This is a hands-on technical role sitting at the intersection of Software Engineering and Data Engineering, focused on building secure, production-grade data services that operate reliably within highly governed Defence environments.What you’ll be doing:Building scalable data applications and pipelines using PythonDeveloping streaming, event-driven and orchestrated data solutionsDeploying and supporting containerised services in Kubernetes environmentsImplementing observability, monitoring and data governance best practicesLeveraging Infrastructure as Code and CI/CD for secure deploymentsOwning solutions from design and development through to production supportDelivering resilient data platforms within secure Defence environmentsWhat we’re looking for:Strong Python development and software engineering experienceExperience building scalable data pipelines and distributed data platformsKnowledge of Kafka, Spark and modern data processing technologiesExperience with orchestration tools such as Airflow, Dagster or PrefectHands-on experience with Docker, Kubernetes and containerised deploymentsCI/CD experience with a focus on production ownership and reliabilityUnderstanding of data quality, testing and lineage best practicesDesirable skills:MLOps or production machine learning experienceTerraform, Ansible or other Infrastructure as Code toolsPostgreSQL and modern data platformsExperience within Defence, National Security or regulated environmentsFamiliarity with air-gapped, restricted or secure networksKnowledge of Google Distributed Cloud (GDC) or edge cloud technologiesSecurity Clearance:Due to the nature of the work, candidates must hold an active SC Clearance and be a British passport holder.