Data Engineer & Architect in San Antonio

Energy Jobline is the largest and fastest growing global Energy Job Board and Energy Hub. We have an audience reach of over 7 million energy professionals, 400,000+ monthly advertised global energy and engineering jobs, and work with the leading energy companies worldwide.

We focus on the Oil & Gas, Renewables, Engineering, Power, and Nuclear markets as well as emerging technologies in EV, Battery, and Fusion. We are committed to ensuring that we offer the most exciting career opportunities from around the world for our jobseekers.

Job DescriptionJob Description

Job Description

Job Title: Data Engineer & Architect

This position is an on-site assignment ().

Summary:

We are seeking a talented and experienced Data Engineer & Architect with operations support experience and data architecture capabilities. The ideal candidate will have a passion for data, strong design thinking, and a desire to help shape scalable cloud‑based data solutions. This role will support production data operations, develop new features and pipelines, and contribute to the design of enterprise data architecture across AWS and Databricks.

Wage Type: Salaried

Essential Duties & Responsibilities:

To perform this job successfully, an individual must be able to perform each of the essential duties satisfactorily. Reasonable accommodation may be made to enable individuals with disabilities to perform the essential functions.

Operations Support

• Be the go-to person for production support. Troubleshoot issues, identify bottlenecks, and ensure smooth data operations.
• Work closely with our partners and internal staff to address any data-related concerns promptly.
• Keep a watchful eye on system performance and proactively address any anomalies.

Data Engineering

• Design, develop, and maintain scalable cloud-based data architectures on AWS and Databricks.
• Implement efficient ETL/ELT processes using Databricks notebooks, Delta Lake, and Apache Spark.
• Collaborate with cross-functional teams to understand data requirements and ensure data solutions meet business needs.
• Utilize AWS services such as S3, Glue, Redshift, and EMR, and integrate with Databricks Workspaces for unified data processing.
• Ensure data security, integrity, and compliance with industry standards and regulations, including role-based access control (RBAC) in Databricks.
• Troubleshoot and optimize existing ETL processes for performance and reliability using Databricks performance tuning techniques.
• Stay updated on emerging cloud technologies and recommend improvements to enhance data engineering capabilities, including Databricks Lakehouse architecture.
• Collaborate with data scientists and analysts to provide accessible and high-quality data for analytics and reporting via Databricks SQL and Unity Catalog.

Data Architecture

• Participate in designing enterprise‑level data models (conceptual, logical, physical) to support Lakehouse and warehouse structures.
• Define and maintain data standards, naming conventions, and architectural patterns for ingestion, transformation, storage, and governance.
• Evaluate system architecture and make recommendations to support scalability, performance, and cost optimization across AWS and Databricks.
• Assist in defining canonical data entities and integration patterns used across the organization.
• Contribute to solution architecture for data pipelines, APIs, and event‑driven data flows.
• Support the creation of technical documentation including data dictionaries, lineage diagrams, and architectural diagrams.
• Partner with security and governance stakeholders to ensure adherence to data stewardship, quality, and compliance principles.
• Provide architectural input during project planning, backlog grooming, and cross‑team design discussions.
• Carry out responsibilities with professionalism, respect for others, in accordance with the organization's policies and applicable laws
• Any other duties as assigned.

Key Deliverables:

• Reliable production support of the cloud‑based data ecosystem through troubleshooting, debugging, analysis, and code deployments, including Databricks job orchestration and monitoring.
• Support for data warehouse and Lakehouse maintenance, including patches, upgrades, and workspace configuration.
• Clear communications around data initiatives, planning, and problem resolution, including Databricks workspace collaboration.
• Architectural documentation, including data flow diagrams, detailed solution designs, and model definitions.

Organizational Structure:

Reports to: Head of Integrations & Data Engineering

Supervises: N/A

Qualifications:

Education:

• Bachelor's degree in Computer Science, Information Technology, or a related field.

Required Knowledge/Skills:

• Proven experience as a Cloud Data Engineer with expertise in AWS and Databricks.
• Strong background in ETL/ELT development using Apache Spark and Databricks.
• Familiarity with data modeling, database design, and optimization techniques in Delta Lake.
• Experience with Databricks SQL, Unity Catalog, and MLflow is a plus.
• Ability to work collaboratively using Databricks Repos and version control.
• Strong communication skills for translating technical concepts to non-technical stakeholders.
• Understanding of data architecture concepts such as modeling patterns, data governance, and domain‑driven design frameworks.

Desired Experiences:

• AWS certifications in relevant areas.
• Databricks certifications in relevant areas.
• Experience with Apache NiFi, Apache NiFi Registry.
• Experience with Databricks administration, including workspace setup, cluster configuration, and access control.
• Knowledge of data warehousing and Lakehouse architecture.
• Familiarity with DevOps practices in a cloud environment, including CI/CD pipelines integrated with Databricks.
• Knowledge of Banking and Financial Services.

Talents:

• Strong positivity.
• Mission driven, competitive, goal oriented, and motivated to develop themselves and others.
• Energetic, resourceful, and appropriate work intensity to get the work done

• Strong people acumen and relationship skills; Naturally pre-disposed to quickly establish positive personal and professional relationships.

Other:

• Ability to interpret a variety of instructions furnished in written, oral, diagram or schedule form.
• Must be able to lift to 20 pounds.

TransPecos Banks will not accept unsolicited resumes from any source other than the candidate. We will consider any candidate for whom an Agency submits an unsolicited resume, to have been referred to us by the Agency free of any charges or fees, other than those agencies we engage on a specific search. TransPecos Banks will not pay a for any placement resulting from the receipt of an unsolicited resume.

If you are interested in applying for this job please press the Apply Button and follow the application process. Energy Jobline wishes you the very best of luck in your next career move.