Big-data platform operations development engineer-N
岗位职责:- 负责设计和构建大数据平台的各类组件，包括但不限于数据采集，计算，对外服务及治理平台的设计和开发搭建，降低数据的使用门槛，实现数据的最大价值；- 基于开源解决方案，构建完整的数据开发、治理框架，以满足实时、近实时以及批量计算的需求。- 持续升级和解决开源产品中的问题，包括Spark、Hive、Hdfs、Hudi、StarRocks中的bug修复，基于源码的新功能开发和集成。- 探索和实践新技术和现有平台的集成。技能和要求:- 计算机相关专业，本科及以上学历。4年以上大数据相关工作经验。- 精通一种或多种大数据相关组件技术，包括但不限于 Hadoop、Spark、Hive、Flink、Debezium、Canal、ELK、Clickhouse、Starrocks(doris)、调度系统、元数据管理系统、搜索引擎技术等，理解其内部原理和适用场景，了解核心源码及调优方法。精通Spark的优先考虑。- 精通Java，基础扎实 ，对于多线程、网络、IO方面有实际的应用经验，了解Java 内存模型，垃圾回收机制，对于Java的内存监控、调优、线上Debug有丰富经验。- 有大数据中台建设经验、数据治理经验者优先。- 熟悉Yarn、Kubernetes等调度和资源管理系统，参与过大型集群的搭建或维护优先。- 熟悉Azure , AWS, GCP的优先。- 需要熟练的英文读写能力，口语能力好的优先考虑。What’s In It For You?Elective Benefits: Our programs are tailored to your country to best accommodate your lifestyle.Grow Your Career: Accelerate your path to success (and keep up with the future) with formal programs on leadership and professional development, and many more on-demand courses.Elevate Your Personal Well-Being: Boost your financial, physical, and mental well-being through seminars, events, and our global Life Empowerment Assistance Program.Diversity, Equity & Inclusion: It’s not just a phrase to us; valuing every voice is how we succeed. Join us in celebrating our global diversity through inclusive education, meaningful peer-to-peer conversations, and equitable growth and development opportunities.Make the Most of our Global Organization: Network with other new co-workers within your first 30 days through our onboarding program.Connect with Your Community: Participate in internal, peer-led inclusive communities and activities, including business resource groups, local volunteering events, and more environmental and social initiatives.Don’t meet every single requirement? Apply anyway. At TD SYNNEX, we’re proud to be recognized as a great place to work and a leader in the promotion and practice of diversity, equity and inclusion. If you’re excited about working for our company and believe you’re a good fit for this role, we encourage you to apply. You may be exactly the person we’re looking for!