Data Engineer

Data Engineer (Azure Databricks)

Job Title: Data Engineer

Location: London/Hybrid

Experience: 6–8+ years

We are looking for an experienced Data Engineer with strong expertise in Azure Databricks, Azure Data Factory (ADF), and Data Engineering to join our team.

The ideal candidate will have extensive experience designing, developing, and optimising complex data pipelines, working with large-scale datasets, and delivering reliable, scalable data engineering solutions within the Azure ecosystem.

Essential Skills & Experience

• Minimum 6–8 years of relevant experience in Data Engineering or Data Software Engineering.
• Strong hands-on experience with Azure Databricks.
• Extensive experience designing and implementing complex data pipelines using Azure Data Factory (ADF).
• Strong understanding of Azure cloud services and data engineering principles.
• Proven experience optimising data processing performance across large datasets (millions of records).
• Excellent problem-solving and troubleshooting skills.
• Strong communication and collaboration skills.

Desirable Skills

• Experience developing data engineering solutions using Scala.
• Experience working in Agile development environments.
• Databricks certification.
• Good understanding of CI/CD pipelines and deployment practices.