Senior BigData Engineer in Wilmington
Energy Jobline is the largest and fastest growing global Energy Job Board and Energy Hub. We have an audience reach of over 7 million energy professionals, 400,000+ monthly advertised global energy and engineering jobs, and work with the leading energy companies worldwide.
We focus on the Oil & Gas, Renewables, Engineering, Power, and Nuclear markets as well as emerging technologies in EV, Battery, and Fusion. We are committed to ensuring that we offer the most exciting career opportunities from around the world for our jobseekers.
Job DescriptionJob Description
Hi.,
Hope you are doing well.
This is Krishna from ICS Global Soft Inc. Kindly find the belowjob description and let me know your availability.
Requirement:
Role: Senior BigData Engineer
Location: Wilmington, DE
Duration: Multi-Year Contract
Job Description:
•Will join a growing team buildinga modernized Data Ecosystem.
•Responsible for expanding andoptimizing data and data pipeline architecture, modernizing data ecosystem withopen source technologies as well as optimizing data flow and collection forcross functional teams.
•Project Details: Datamodernization project from scratch. Theyare taking their legacy data platform and migrating everything into AWS. Theywill be analyzing current platform, planning and designing how to set up thenew data/ETL pipelines, then start coding.
Technical Experience:
•Big data tools: Hadoop, ApacheSpark, Kafka, etc.
•Relational SQL, Snowflake andNoSQL databases, including Postgres and Cassandra.
•Data pipeline and workflowmanagement tools: NiFi, Kylo, Luigi, Airflow, Azkaban etc.
•AWS cloud services: S3, EC2, EMR,RDS, Redshift
•Stream-processing systems: Storm,Spark-Streaming, etc.
•Object-oriented/object functionscripting : Python, Java, C++, PySpark, Scala
General Responsibilities:
•Create and maintain optimal datapipeline architecture.
•Assemble large, complex data setsthat meet functional / non-functional business requirements.
•Identify, design, and implementinternal process improvements: automating manual processes, optimizing datadelivery, re-designing infrastructure for greater scalability, etc.
•Build the infrastructure requiredfor optimal extraction, transformation, and loading of data from a wide varietyof data sources using SQL and AWS ‘big data’ technologies.
•Build analytics tools thatutilize the data pipeline to provide actionable insights into customeracquisition, operational efficiency and other key business performance metrics.
•Workwith stakeholders including the Executive, Product, Data and Design teams toassist with data-related technical issues and support their data infrastructureneeds.
Best Regards
Krishna Chalasani
RecruitmentLead
1231 Greenway Drive | Ste 375 | Irving, TX 75038
E-mail: krishna@icsglobalsoftinc.com
Office: 972-483-5871 | Cell:469-301-7520
NMSDC Certified | Certified Minority Business Enterprise (MBE), SBE | AnE-Verify company
According to Bill S.1618 Title III passed by the 105th US Congress, thismessage is not considered as "Spam" as we have included the contactinformation. If you wish to be removed from our mailing list, please respondwith "remove" in the subject field. We apologize for anyinconvenience caused..
If you are interested in applying for this job please press the Apply Button and follow the application process. Energy Jobline wishes you the very best of luck in your next career move.