Data Pipeline Developer
Join to apply for the
Data Pipeline Developer
role at
Red Cedar Consultancy, LLC
Continue with Google Continue with Google
2 days ago Be among the first 25 applicants
Join to apply for the
Data Pipeline Developer
role at
Red Cedar Consultancy, LLC
Get AI-powered advice on this job and more exclusive features.
Sign in to access AI-powered advices
Continue with Google Continue with Google
Continue with Google Continue with Google
Continue with Google Continue with Google
Continue with Google Continue with Google
Continue with Google Continue with Google
Continue with Google Continue with Google
Summary
The Data Pipeline Specialist is responsible for the end-to-end design, development, deployment, and maintenance of robust data pipelines supporting the IRS Enterprise Data Platform (EDP). This role drives the ingestion, transformation, and integration of large-scale, complex datasets from diverse IRS legacy and modern source systems into cloud-based analytic environments. Leveraging advanced expertise in ETL/ELT development, cloud- data engineering (e.g., Databricks, AWS RDS/Postgres, Redshift, MongoDB, DynamoDB), and scripting , the Data Pipeline Specialist ensures data accuracy, security, and continuous availability across transactional, analytical, and API data stores. The Specialist works closely with data engineers, analysts, and project stakeholders to convert business requirements and legacy code (such as PL/SQL, Greenplum, Oracle) into efficient, scalable, and compliant pipelines. This position also supports ongoing operations and maintenance, including troubleshooting, enhancements, and performance tuning, and plays a vital role in enabling advanced analytics, reporting, and real-time data access to empower IRS's IT modernization and analytics goals. The Data Pipeline Specialist ensures all solutions are developed in alignment with IRS standards, OneSDLC, and compliance mandates such as FISMA, FedRAMP, Section 508.
Job Title:
Data Pipeline Developer
Summary
The Data Pipeline Specialist is responsible for the end-to-end design, development, deployment, and maintenance of robust data pipelines supporting the IRS Enterprise Data Platform (EDP). This role drives the ingestion, transformation, and integration of large-scale, complex datasets from diverse IRS legacy and modern source systems into cloud-based analytic environments. Leveraging advanced expertise in ETL/ELT development, cloud- data engineering (e.g., Databricks, AWS RDS/Postgres, Redshift, MongoDB, DynamoDB), and scripting , the Data Pipeline Specialist ensures data accuracy, security, and continuous availability across transactional, analytical, and API data stores. The Specialist works closely with data engineers, analysts, and project stakeholders to convert business requirements and legacy code (such as PL/SQL, Greenplum, Oracle) into efficient, scalable, and compliant pipelines. This position also supports ongoing operations and maintenance, including troubleshooting, enhancements, and performance tuning, and plays a vital role in enabling advanced analytics, reporting, and real-time data access to empower IRS's IT modernization and analytics goals. The Data Pipeline Specialist ensures all solutions are developed in alignment with IRS standards, OneSDLC, and compliance mandates such as FISMA, FedRAMP, Section 508.
Responsibilities
Develop robust, scalable data pipelines for the ingestion, transformation, and load (ETL/ELT) of IRS source system data into the EDP platform (with focus on Databricks, AWS RDS/Postgres, Redshift, MongoDB, DynamoDB, etc.).
Convert and optimize legacy ETL processes-including complex PL/SQL, Greenplum, and Oracle stored procedures-to modern, scalable cloud- data processing using Databricks and Informatica ETL tools.
Implement data integration and orchestration workflows ensuring data accuracy, completeness, and integrity across transactional, analytical, and API data stores.
Develop and document pipeline designs, deployment scripts, test plans, and system interfaces in accordance with EDP and Solution Engineering standards.
Partner with data engineering and analytics teams to deliver high-quality, production-ready data products supporting advanced analytics and reporting use cases.
Support the creation of API-based data access services, enabling secure and efficient integration with internal and external IRS programs.
Perform all required testing (system, integration, performance, Section 508, security), remediate defects
Participate in operations and maintenance support for pipeline issue resolution and enhancement
Requirements
Must have demonstrated development experience with at least 2 project similar in size and scope to transform and load data into Databricks.
Hold both an active IRS and an active or non-active MBI clearance
Qualifications
Prior experience working with the IRS as a contractor or employee
Seniority level
Seniority level Entry level
Employment type
Employment type Full-time
Job function
Job function Information Technology
Industries IT Services and IT Consulting
Referrals increase your chances of interviewing at Red Cedar Consultancy, LLC by 2x
Get notified about new Data Engineer jobs in
Leesburg, VA .
North Bethesda, MD $55,000 - $125,000 2 weeks ago
Ashburn, VA $86,181.60 - $107,727 3 weeks ago
Chantilly, VA
$235,000.00
-
$300,000.00
1 month ago
Reston, VA
$86,300.00
-
$164,000.00
6 months ago
Fairfax, VA
$80,000.00
-
$100,000.00
4 days ago
McLean, VA
$80,000.00
-
$100,000.00
1 day ago
Rockville, MD
$112,597.33
-
$152,810.66
1 month ago
Tysons Corner, VA
$112,597.33
-
$152,810.66
1 month ago
Reston, VA
$73,722.00
-
$125,327.00
1 week ago
Tysons Corner, VA $144,768 - $209,109.33 1 month ago
Rockville, MD $144,768 - $209,109.33 1 month ago
Reston, VA $86,300 - $164,000 5 months ago
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr