Technical Architect- Data Platforms in London

Energy Jobline is the largest and fastest growing global Energy Job Board and Energy Hub. We have an audience reach of over 7 million energy professionals, 400,000+ monthly advertised global energy and engineering jobs, and work with the leading energy companies worldwide.

We focus on the Oil & Gas, Renewables, Engineering, Power, and Nuclear markets as well as emerging technologies in EV, Battery, and Fusion. We are committed to ensuring that we offer the most exciting career opportunities from around the world for our jobseekers.

Job Description

Technical Architect – Data Platforms

Location: London / Manchester (Hybrid)

Clearance:Active UK SC Clearance (mandatory)

Circa £65,000- £85,000

Overview

We are looking for an experienced Technical Architect to design and evolve large-scale, cloud-based data platforms. The role focuses on AWS data ecosystems with growing adoption of Microsoft Fabric, supporting enterprise clients through platform build, migration, and optimisation.

Key Responsibilities

• Define architecture for data ingestion, processing, and access layers
• Design scalable, resilient data platforms (hub-and-spoke, lake/lakehouse)
• Lead implementation of batch and real-time pipelines (Kafka, APIs, SFTP)
• Architect solutions using:
• AWS (S3, EMR, Glue)
• PySpark / Python
• Support cloud migrations and platform modernisation
• Ensure best practices in CI/CD, Terraform, observability, and governance
• Handle schema evolution, data quality, and performance optimisation
• Collaborate across engineering, DevOps, and business teams
• Provide technical leadership and mentoring

Required Experience

• Active SC Clearance (essential)
• Strong experience with AWS data platforms (S3, EMR, Glue)
• Expertise in data lake / lakehouse architectures
• Experience with Kafka / event-driven architectures
• Strong Python & PySpark skills
• Experience with Terraform and CI/CD pipelines
• Proven track record designing large-scale data solutions

Desirable

• Experience with Microsoft Fabric (highly )
• Exposure to Azure / Databricks
• Experience in enterprise-scale environments

If you are interested in applying for this job please press the Apply Button and follow the application process. Energy Jobline wishes you the very best of luck in your next career move.