Lead Data Platform Engineer in Sheffield

Energy Jobline is the largest and fastest growing global Energy Job Board and Energy Hub. We have an audience reach of over 7 million energy professionals, 400,000+ monthly advertised global energy and engineering jobs, and work with the leading energy companies worldwide.

We focus on the Oil & Gas, Renewables, Engineering, Power, and Nuclear markets as well as emerging technologies in EV, Battery, and Fusion. We are committed to ensuring that we offer the most exciting career opportunities from around the world for our jobseekers.

Job Description

Lead Data Platform Engineer

£75,000 - £85,000

Remote

You are a well-experienced Lead Data Platform Engineer, looking to take ownership of a modern lakehouse platform and shape best-in-class data engineering practices.

THE COMPANY

This industry-leading organisation serves specialist, people-first knowledge to its clients and is looking to provide further expertise by improving its data capabilities.

THE ROLE

As a Lead Data Engineer you will build a Databricks platform with ownership, shaping how data is engineered, deployed, automated, and governed in Azure.

Specifically, you can expect to be involved in the following:

• Designing and developing end-to-end data platform solutions in Azure using Databricks
• Building and maintaining automation for cluster management, monitoring, tagging, and platform optimisation.
• Implementing CI/CD and DevOps best practices across data pipelines and platform components.
• Taking ownership of design decisions and long-term architectural direction.

SKILLS AND EXPERIENCE

The successful Lead Data Engineer will have the following skills and experience:

• Deep expertise with Azure Databricks, including development, deployment, and platform-level engineering.
• Strong software engineering capability across Pyspark, Spark SQL and Azure Data Factory.
• Solid understanding of DevOps practices including CI/CD and automated testing.
• Experience with monitoring, logging, and alerting solutions.
• Ability to work effectively with stakeholders across engineering functions.

BENEFITS

The successful Lead Data Platform Engineer will receive the following benefits:

• Salary between £75,000 - £85,000 - depending on experience
• Competitive bonus and benefits.
• Remote work with a flexible 35-hour week that can be taken as a 4-day week.

HOW TO APPLY

Please register your interest by sending your resume to Majid Latif via the Apply link on this page.

If you are interested in applying for this job please press the Apply Button and follow the application process. Energy Jobline wishes you the very best of luck in your next career move.