Senior Data Engineer (Databricks / Apache Spark) in Washington
Energy Jobline is the largest and fastest growing global Energy Job Board and Energy Hub. We have an audience reach of over 7 million energy professionals, 400,000+ monthly advertised global energy and engineering jobs, and work with the leading energy companies worldwide.
We focus on the Oil & Gas, Renewables, Engineering, Power, and Nuclear markets as well as emerging technologies in EV, Battery, and Fusion. We are committed to ensuring that we offer the most exciting career opportunities from around the world for our jobseekers.
Job DescriptionJob Description
Senior Data Engineer (Databricks / Apache Spark)
Agency: US Coast Guard
Location: Remote / Hybrid (as permitted by contract) must be proximate to Washington DC Metro area (within 60 miles)
Experience Level: Senior (8+ years)
Salary Range: $190- 200K
Clearance: Ability to Obtain Public Trust
US Citizenship Required
Position Overview
World Services LLC, an IT engineering, solutions, and management consulting firm, is seeking an experienced Senior Data Engineer to support a federal agency on an enterprise-wide digital transformation initiative.
The Senior Data Engineer designs, builds, and optimizes scalable, secure data pipelines and analytics platforms in support of mission-critical federal data initiatives. This role translates complex business, analytical, and mission requirements into high-performance data solutions using Databricks, Apache Spark, Python, and SQL within cloud-based environments.
This is a hands-on senior delivery role requiring deep Spark expertise, advanced data modeling skills, and experience operating data platforms in regulated or high-availability environments.
At World Services LLC, you’ll work in a collaborative, people-first culture within a stable, mission-driven federal environment, building secure, resilient systems that support critical programs alongside experienced teams.
KEY RESPONSIBILITIES
Senior Data Engineering & Architecture
· Design, develop, and maintain large-scale ETL/ELT data pipelines using Databricks and Apache Spark.
· Architect and implement Databricks Lakehouse solutions leveraging Delta Lake.
· Develop advanced SQL transformation layers and analytics-ready datasets.
· Implement dimensional data models (star and snowflake schemas).
· Assess current state data solutions and provide recommendations for improvements.
Performance Optimization & Data Quality
• Tune Spark jobs, cluster configurations, and Databricks workflows.
• Diagnose and remediate complex data quality issues.
• Implement validation frameworks, monitoring, and data checks.
Cloud & DevSecOps Integration
• Build and maintain data pipelines across cloud platforms (AWS, Azure, or GCP).
• Integrate workflows into CI/CD pipelines with DevSecOps teams.
• Maintain non-production environments without impacting production.
• Ensure compliance with federal security and governance requirements.
Collaboration & Technical Leadership
· Translate mission and analytical requirements into technical solutions.
· Mentor junior and mid-level data engineers.
· Support production operations and issue resolution.
· Produce technical documentation.
· Align with the agency’s data Program Management Office (PMO) related requirements and governance standards
REQUIRED QUALIFICATIONS
• 8+ years of overall data engineering experience.
• 3+ years of hands-on Databricks and Apache Spark experience.
• Expert proficiency in Spark, Python, and SQL.
• Experience delivering enterprise-scale cloud data platforms.
• Familiarity with federal or regulated environments.
STRONGLY QUALIFICATIONS
• Databricks Certified Data Engineer (Professional or Associate).
• Experience supporting DHS, DoD, or other federal agencies.
• Experience with streaming architectures (Kafka, Spark Structured Streaming).
• Cloud certifications (AWS, Azure, or GCP).
EDUCATION
• Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or related field.
• Master’s degree .
Company DescriptionWorld Services, LLC is a Service-Disabled Veteran-Owned Small Business (SDVOSB), headquartered in Alexandria, Virginia. We offer a wide variety of IT services to support enterprises at every level. These include Management Consulting, Cloud Architecture, Software Development, Agile Implementation, Data Science and Analytics, Systems Engineering, Augmented Reality, and Cyber Security services. World Services commitment to a quality delivery of technology and services is backed by the ISO 9000 certified and CMMI Level 3 in Services and Development to ensure a quality framework of policies, tools, and procedures. This is one of the factors that allow our company as a ISO certified and CMMI Level 3 rated small business to deliver consistent, scalable solutions to the Federal, State and Local Government, healthcare, and commercial clients. Our quality processes ensure our customers receive shorter lead time, delivery reliability, and consistent, high-quality services and products.Company DescriptionWorld Services, LLC is a Service-Disabled Veteran-Owned Small Business (SDVOSB), headquartered in Alexandria, Virginia. We offer a wide variety of IT services to support enterprises at every level. These include Management Consulting, Cloud Architecture, Software Development, Agile Implementation, Data Science and Analytics, Systems Engineering, Augmented Reality, and Cyber Security services. World Services commitment to a quality delivery of technology and services is backed by the ISO 9000 certified and CMMI Level 3 in Services and Development to ensure a quality framework of policies, tools, and procedures. This is one of the factors that allow our company as a ISO certified and CMMI Level 3 rated small business to deliver consistent, scalable solutions to the Federal, State and Local Government, healthcare, and commercial clients. Our quality processes ensure our customers receive shorter lead time, delivery reliability, and consistent, high-quality services and products.
If you are interested in applying for this job please press the Apply Button and follow the application process. Energy Jobline wishes you the very best of luck in your next career move.