Lead Data Engineer

Lead Data Engineer At a Glance Senior hands-on lead role within a growing Belfast data practice... genuine influence over how it is built Databricks on Azure at the core... Delta Lake, Spark, and MLflow across complex financial data programmes Financial Services domain: risk, trading, compliance, and regulatory data Hybrid working from Belfast city centre About the Company Our client is a global professional services firm with a dedicated AI and Data practice specialising in Financial Services. They work with some of the most complex and heavily regulated institutions in the sector, and their Belfast team is expanding specifically to build out a Data Engineering capability. This is an early-stage opportunity with global infrastructure behind it... well-resourced, well-connected, and serious about what they are building. The Role This is a senior, hands-on technical leadership position sitting within the AI and Data team. You will take ownership of Data Engineering in Belfast, with an initial focus on Databricks delivery for Financial Services clients. The work is substantive: large-scale data transformations, complex migrations from legacy platforms, and architecture that has to meet the demands of regulated environments. You will work closely with both technical and business stakeholders, translating regulatory and commercial requirements into robust data solutions, and you will mentor the engineers around you as the practice grows. If you want to build something meaningful within a globally connected environment, this is the role. Key Responsibilities Lead the design and implementation of scalable data architecture solutions using Databricks on Azure Architect and optimise data pipelines for structured and unstructured financial data, with a focus on performance, reliability, and compliance Stand up and operationalise Databricks platforms, including workspace setup, cluster configuration, and CI/CD integration Lead large-scale data migrations from legacy platforms to Databricks with minimal disruption and high data fidelity Drive adoption of Delta Lake, Apache Spark, and MLflow across analytics and machine learning use cases Establish best practices for data governance, lineage, and metadata management within Databricks Ensure data architecture aligns with relevant financial regulations including GDPR, Basel III, and MiFID II Lead performance tuning, cost optimisation, and security hardening of Databricks on Azure Mentor and provide technical leadership to data engineers and analysts across the practice Translate client business requirements into data products that support real-time decision-making and predictive modelling What You'll Need Essential: 7+ years of data engineering experience with a proven track record delivering large-scale Databricks transformations in production Relevant Databricks industry certifications Deep understanding of Financial Services data across at least one of: risk, trading, compliance, or regulatory domains Experience leading and developing high-performing data engineering teams Ability to engage confidently with senior stakeholders and manage cross-functional programmes Strong command of cloud-based data technologies and a clear view on market direction Exceptional communication skills, with the ability to bridge technical and business audiences effectively Degree-level education or equivalent demonstrable experience Nice to have: Prior experience operating within or alongside regulated financial institutions Exposure to Data Science, ML, or AI solution delivery Why Apply? Hybrid working from Belfast city centre Join a practice at formation stage... real influence over how it is built from the ground up Complex, high-stakes data programmes in one of the most technically demanding sectors Access to global resources, training, and career development within a large professional services network Genuine autonomy with senior visibility from day one Next Steps To discuss in confidence, connect with Ryan Quinn on LinkedIn or reach out directly at . Skills: Databricks Azure SQL Benefits: Work From Home Bonus
TPBN1_NI