iO Associates
City Of Westminster / Global
Senior Data Engineer
- Remote
You have blocked notifications
Oops! You have blocked notifications. Click here for more info
You have blocked notifications, please check your browser settings.
You're currently subscribed to job notifications
Subscribe to notifications
You will no longer receive notifications
City Of Westminster / Global
My client is looking for an experienced Senior Data Engineer to join them on a contract basis, taking end‑to‑end ownership of business‑critical data products on their Azure Databricks‑based data platform. This is a hands‑on role embedded directly within a product team, working closely with product managers and lead engineers to raise engineering quality and shape how modern data products are built for analytics and AI.The RoleAs a Senior Data Engineer, you will:Design scalable data products within a cross‑functional product teamAct as a senior technical partner to product managers and lead data engineersBuild and maintain high‑quality data pipelines using Databricks & SparkConvert requirements into clear technical designs and conceptual data modelsIngest large, complex datasets and automate manual processesImprove data quality, observability, reliability, and delivery performanceChampion a build‑once‑consume‑many culture across the platformCollaborate with stakeholders to solve data‑related engineering challengesContribute to engineering standards, best practices, and platform evolutionMentor other engineers and raise the overall engineering barTech EnvironmentMy client is actively modernising their platform, moving away from legacy IaaS solutions and building a Databricks‑first Lakehouse. Spark, Delta Lake, CI/CD, and modern DevOps practices are central to how they design and scale data products.What You’ll NeedStrong hands‑on experience with Azure Databricks & Spark in production5+ years in data engineering or software engineering with a strong data focusExperience building production‑grade pipelines on AzureStrong SQL and experience with analytical data models / data warehousingProficiency in Python (Scala a bonus)Experience delivering enterprise‑grade data products used by multiple teamsAbility to communicate clearly with both technical and non‑technical audiencesExperience with Azure Synapse (dedicated/serverless SQL pools)Agile mindset; experience working in Scrum teamsNice to HaveHands‑on experience with Docker, Kubernetes, or container orchestrationStart: ASAPLocation: London (with remote flexibility)Length: 6 months (likely extension)Rate: Competitive, depending on experience
#J-18808-Ljbffr
Greater London / Global
GB / Global
GB / Global
GB / Global
GB / Global
London / Global