Data Engineer

We are looking for an experienced Data Engineer to support a data migration and integration programme within a relatively low maturity Azure environment.The role will focus on designing and building robust data pipelines, migrating data from a wide range of legacy and enterprise source systems, and establishing scalable data flows into Azure Data Lake and Databricks. A key part of the role will also involve integrating data into a proprietary data transformation solution where applicable.Key Skills & ExperienceAzure Data EngineeringAzure Data Factory (ADF)Azure Data LakeDatabricksBuilding ETL / ELT pipelinesLarge-scale data migration and integrationOracle and/or Oracle Fusion data sourcesSharePoint data extraction and integrationWorking with multiple and varied source systemsData transformation, mapping and validationDesigning data pipelines in environments where architecture and processes are still developingKey ResponsibilitiesDesign, build and maintain data migration and ingestion pipelines within Azure.Support the setup and development of the Azure Data Lake environment.Build integrations between source systems, Azure Data Lake and Databricks.Develop and manage pipelines using Azure Data Factory (ADF).Extract and migrate data from a variety of source systems, including:OracleOracle FusionInformaticaSharePoint, which will be an initial priorityAdditional enterprise and legacy systems as the programme developsHelp define scalable data ingestion, transformation and migration patterns for future source systems.Support data quality, validation and troubleshooting throughout the migration process.Work closely with technical and business stakeholders to understand source data, target structures and transformation requirements.Help improve the overall maturity of the Azure data environment, introducing appropriate engineering standards and best practices.

#J-18808-Ljbffr