Lead Data Engineer in Washington
Energy Jobline is the largest and fastest growing global Energy Job Board and Energy Hub. We have an audience reach of over 7 million energy professionals, 400,000+ monthly advertised global energy and engineering jobs, and work with the leading energy companies worldwide.
We focus on the Oil & Gas, Renewables, Engineering, Power, and Nuclear markets as well as emerging technologies in EV, Battery, and Fusion. We are committed to ensuring that we offer the most exciting career opportunities from around the world for our jobseekers.
Job DescriptionJob Description
Amida Technology Solutions is a DC-based technology company focused on data interoperability, integrity, governance, and security. We create solutions that collect, reconcile, transform, and standardize data for business intelligence, advanced analytics, decision support, and user transactions. We specialize in taking data from inception to impact.
Our team is composed of creative, forward-looking thinkers who are passionate about using cutting-edge technology to improve lives and generate a positive impact on our country. We offer an entrepreneurial, high-growth environment that values fresh ideas, candid conversations, and authentic teamwork.
Amida Technology Solutions is seeking a skilled Lead Data Engineer. The successful candidate will design and develop data pipelines using Databricks, Azure Data Factory, Azure Synapse Analytics, and other platforms within Azure Cloud. This role will report to Data Engineering Manager. The ideal candidate will be motivated by the opportunity to support public agencies, nonprofit organizations, and private companies in transforming their data into actionable insights. Preference will be given to candidates able to work a hybrid schedule in our DC headquarters office.
Key Responsibilities
- Lead the design, development, and maintenance data pipelines for Extract, Transform, Load (ETL) data on Azure platforms (focusing on Databricks)
- Optimize data flow to ensure high-quality data integrity, consistency, and reliability
- Monitor and troubleshoot data pipeline issues, ensuring high availability and performance
- Collaborate with data scientists, analysts, and stakeholders to understand data requirements and translate them into technical solutions
- Document data workflows, architecture, and technical processes
- Implement data governance and security best practices
- Automate data workflows to improve efficiency and reduce manual efforts
- Lead and mentor other engineers
- Other duties as assigned
Required Education:
- Bachelor's degree in computer science, Information Technology, or a related field
Required Experience:
- 7+ years of experience with Python and one or more programming such as Java, Scala or SQL
- 3+ years of experience leading and mentoring data engineers
- 4+ years of experience building data pipelines using Azure services (e.g., Azure Databricks, Azure Data Factory, Azure Synapse, Azure Functions)
- 4+ years of experience developing solutions on Azure
- 2+ years of experience working with Databricks
- Experience with version control and software development collaboration tools such as Git and GitHub
- Experience using resources in cloud environments such as AWS or Azure
Required Skills:
- Expertise in ETL processes, data modeling, and database design.
- Proficiency in programming such as Python or Java
- Expertise in Delta Lake and other file storage formats including CSV, JSON and Parquet
- Strong problem-solving skills and attention to detail
- Excellent communication and collaboration abilities
- Ability to obtain a Public Trust security clearance
Skills:
- Familiarity with VA infrastructure and data sources
- Proficiency in Cypher query
- Proficiency in graph data modeling concepts
- Experience with database systems and data warehousing technologies such as MySQL, PostgreSQL, MongoDB, Amazon Redshift, Microsoft SQL Server, etc.
This is not a remote position. Priority will be given to candidates who can work from our Washington, D.C. or Richmond office.
Success at Amida
Communication is the key to success at Amida. Our people are known for their can-do attitude and their ability to work effectively with both internal and client teams. We pride ourselves on having a collegial, multidisciplinary team with diverse backgrounds and experience. Our best team members pay intense attention to detail in all aspects of their work, have great initiative, are opinionated about the best ways of doing things, and align quickly to decisions. A sense of humor is an asset at Amida.
Full-time, regular employees at Amida enjoy a robust benefits package that includes a generous 401(k) match with immediate vesting, 4 weeks of PTO, paid parental leave, medical insurance, dental insurance, vision insurance, life AD&D insurance, and short-term . We also offer tuition/training assistance and team building opportunities to encourage professional growth and collaboration.
All qualified applicants will receive consideration without regard to , , , , , , , , protected veteran status, or any other characteristic protected by law.
If you are interested in applying for this job please press the Apply Button and follow the application process. Energy Jobline wishes you the very best of luck in your next career move.