Senior Data Engineer in McLean
Job Description
Job Title: Senior Data Engineer
\n
Location: Mclean, VA/ Richmond, VA - Hybrid
\n
Duration: 07+ Months Contract with Extension
\n
Job id – 180924
\n
\n
Responsibilities:
\n
Designing and implementing high-performance data pipelines that handle large volumes of data
\n
Ensuring data integrity through advanced quality checks and lineage tracking
\n
\n
Required Skills & Qualifications:
\n
Core : Expert-level proficiency in Python and PySpark.
\n
AWS Ecosystem: Deep hands-on experience with AWS Glue and Amazon EMR.
\n
Big Data Architecture: Proven track record of building scalable pipelines for large-scale data (Terabyte-scale ).
\n
Data Integrity: Demonstrated experience implementing frameworks for Data Lineage and Data Quality.
\n
Database Knowledge: Strong experience working with S3-based lakes and relational databases (RDS/PostgreSQL/MySQL).
\n
\n
Experience
\n
Industry: Experience within the Financial Services industry is a huge plus.
\n
Real-time Processing: Experience with Kinesis or Kafka integration for low-latency data delivery.
\n
DevOps: Familiarity with CI/CD for data pipelines and Infrastructure as Code.