Big Data Engineer - Government Sector

Description

Apt Resourcesis seeking an experiencedBig Data Engineerfor agovernment client in Abu Dhabi. You will design and implement large-scale data solutions to support AI/ML initiatives and public sector digital transformation.

Key Responsibilities:

Data Pipeline Development:

• Build robust data pipelines usingPython SQL/NoSQL and Airflow
• DevelopETL/ELT processesfor structured/unstructured data
• Managedata lakesand optimize storage solutions

Data Infrastructure:

• Design efficientdata modelsfor analytics
• Implementdata governanceand quality frameworks
• Work withcloud-based data platforms(Azure preferred)

AI/ML Support:

• Prepare and process datasets for machine learning applications
• Collaborate with ML teams on feature engineering

Requirements

• 10-12 yearsof hands-on big data experience
• Expertise in:
• PythonandSQL/NoSQLdatabases
• Airflowfor workflow orchestration
• ETL/ELTpipeline development
• Cloud data platforms(Azure AWS or GCP)

Benefits

To be discussed

Key Skills
Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala
Employment Type : Full-Time
Experience: years
Vacancy: 1