Technology Engineering Lead in Pittsburgh
Job Description
Technology Engineering Lead
\n
\n
Role overview:
\n
We are seeking an experienced Technology Lead to own the design and delivery of an enterprise batch feature store. The ideal candidate is a hands-on data engineering leader who can make sound architecture decisions, guide developers, and take complex data pipelines through to production.
\n
\n
Experience requirements:
\n
- \n
- 8+ years of experience in data engineering, data platforms, or enterprise application development.
- 5+ years of hands-on experience with PySpark, large-scale ETL/ELT development, and advanced SQL.
- 3+ years leading technical design and delivery for data engineering teams.
- Experience in banking or financial services is a plus.
\n
\n
\n
\n
\n
\n
Key responsibilities:
\n
- \n
- Lead the architecture, development, and production rollout of a batch feature store supporting analytics and AI use cases.
- Design scalable PySpark and Impala SQL pipelines that transform data from Hive and Oracle into consistent, reusable features.
- Define technical standards for feature logic, data quality, reconciliation, performance, monitoring, and failure recovery.
- Own batch scheduling and dependencies using CA7 or an equivalent platform.
- Provide hands-on technical direction through design reviews, code reviews, troubleshooting, and mentoring.
- Establish effective Git/Bitbucket, CI/CD, testing, and AI-assisted development practices.
- Coordinate production releases and change management in line with SDLC requirements.
- Work closely with business, analytics, and technology stakeholders to resolve requirements, communicate trade-offs, and deliver against milestones.
- Plan and track work in an Agile environment using Jira.
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
Required skills:
\n
- \n
- Advanced PySpark and Impala SQL, including query and pipeline performance tuning.
- Proven experience designing enterprise-scale ETL/ELT pipelines.
- Strong expertise with Hive and Oracle data platforms.
- Experience with CA7 or equivalent batch scheduling.
- Proficiency in Linux scripting, Git/Bitbucket, and CI/CD.
- Working knowledge of Agile delivery, Jira, SDLC, production release, and change management.
- Practical experience with AI-assisted development tools.
- Strong communication skills and a track record of leading delivery across multiple stakeholder groups.
\n
\n
\n
\n
\n
\n
\n
\n
\n