Skip to main content

Data Engineering- Contract

Good technology exposureGrowth opportunityAbout Our ClientOur client is an insurance company. They are a leading homegrown financial services company, offering consumers a better way to financial freedom. Through innovative, technology-enabled solutions and a wide range of products and services they provide consumers control over their financial wellbeing at every stage of their lives.Job DescriptionResponsibilities:Work with stakeholders to understand needs for data structure, availability, scalability, and accessibility.Develop tools to improve data flows between internal/external systems and the data lake/warehouse.Build robust and reproducible data ingest pipelines to collect, clean, harmonize, merge, and consolidate data sources.Understanding existing data applications and infrastructure architectureBuild and support new data feeds for various Data Management layers and Data LakesEvaluate business needs and requirementsSupport migration of existing data transformation jobs in Oracle, and MS-SQL to Snowflake.Ability to write oracle sql, PLSQL scripts and should have demonstrated working experience in managing the oracle scripts.Should have a good hands on with linux scriptings.Able to document the processes and steps.Develop and maintain datasets.Improve data quality and efficiency.Lead Business requirements and deliver accordingly.Collaborate with Data Scientists, Architect and Team on several Data Analytics projects.Collaborate with DevOps Engineer to improve system deployment and monitoring process.Soft SkillsAbility to work in a collaborative environment and coach other team members on coding practices, design principles, and implementation patterns that lead to high-quality maintainable solutions.Ability to work in a dynamic, agile environment within a geographically distributed team.Ability to focus on promptly addressing customer needs.Ability to work within a diverse and inclusive team.Technically curious, self-motivated, versatile and solution oriented.The Successful ApplicantRequired Qualifications:Bachelor qualification in a computer science or STEM (science, technology, engineering, or mathematics) related field.Atleast 3 years of strong data warehousing experience using RDBMS and Non-RDBMS databases.Atleast 3 years of recent hands-on professional experience (actively coding) working as a data engineer (back-end software engineer considered).Professional experience working in an agile, dynamic and customer facing environment is required.Understanding of distributed systems and cloud technologies (AWS) is highly preferred.Understanding of data streaming and scalable data processing is preferred to have.Experience with large scale datasets, data lake and data warehouse technologies such as AWS Redshift, Google BigQuery, Snowflake. Snowflake is highly preferred.Atleast 2 years of experience in ETL (AWS Glue), Amazon S3, Amazon RDS, Amazon Kinesis, Amazon Lambda, Apache Airflows, Amazon Step Functions.Strong knowledge in scripting languages like Python, UNIX shell and Spark is required.Understanding of RDBMS, Data ingestions, Data flows, Data Integrations etc.Technical expertise with data models, data mining and segmentation techniques.Experience with full SDLC lifecycle and Lean or Agile development methodologies.Knowledge of CI/CD and GIT Deployments.Ability to work in team in diverse/ multiple stakeholder environment.Ability to communicate complex technology solutions to diverse teams namely, technical, business and management teams.What's on OfferCreative and innovative workplaceOpportunity to learn and growGood work culture

Data Engineering- Contract

Page Personnel
Emory, TX 75440
Full time

Published on 05/24/2024

Share this job now