Senior Hadoop Engineer (f/m)

01 Sep 2016
05 Apr 2017
Contract Type
Full Time
  • Be part of CMO driven development projects and ensure the designing, building, installing, configuring and supporting of Hadoop installations
  • Guiding the designing, building, installing and configuring of streaming applications based on Hadoop components (Flume, Kafka, Spark, Storm) as well as NoSQL databases (HBase, MongoDB, Cloudera) for the Customer Solutions, Energy Networks and Renewables Business
  • Pre-processing using Hive and Pig
  • Designing and implementing data interfaces to streaming and CEP applications
  • Translate complex functional and technical requirements into detailed design by ensuring security and data privacy aspects
  • Close collaboration with architects, developers, product owners and other stakeholders to enable modern application development (enable continuous integration and deployment, DevOps)
  • Understanding the competitive environment the Business operates in and knowing what delivers advantage from a digital business perspective
  • Actively identify areas for improvement and contribute to proof-of-concepts to evaluate new technologies, frameworks and architectures to drive innovative ideas into the IT and business
  • Teach younger Hadoop engineers and ensure knowledge transfer in building, monitoring and administration of complex Hadoop clusters based on best practices and standards

  • University degree in engineering, computer sciences, information systems, economics or equivalent professional qualification
  • Several years of experience in Hadoop incl. the components HDFS, Hive, Pig, HBase, Knox, Ranger, Flume, Sqoop, Kafka, Spark, Storm, Ambari, Zookeeper, YARN
  • Good knowledge of workflow / schedulers like Oozie
  • Good experience in scripting, writing high-performance, reliable and maintainable code
  • Excellent knowledge of database structures, theories, principles and practices as well as agile methods like Kanban or Scrum
  • Good aptitude in multi-threading and concurrency concepts
  • Profound knowledge of digital core technologies (e.g. data management, data analytics, integration, process automation, mobile, social, API Management, DevOps, cloud)
  • Excellent English language skills (spoken and written), fluent German language skills preferable
  • Ability to collaborate actively across cultural and organizational boundaries and take ownership of features; high ambition to follow and evaluate new trends and acquire new skills (out-of-the-box thinking)
  • Willingness to accept frequent business trips