数据工程师 Data Engineer
上海育碧电脑软件有限公司
- 公司规模:500-1000人
- 公司性质:外资(欧美)
- 公司行业:计算机软件
职位信息
- 发布日期:2020-03-19
- 工作地点:上海
- 招聘人数:1人
- 工作经验:3-4年经验
- 学历要求:本科
- 职位类别:ETL开发工程师 数据建模工程师
职位描述
What you will do:
- Work in close collaboration with data analysts, understand their needs and design state-of-the-art solutions in line with the existing architecture and best practices.
- Design and develop beautiful data models, easy to understand, easy to use, with strong reusability for various analysis.
- Design and develop optimal data flows (ETL) and processes allowing rapid and efficient data analysis.
- Ensure good performance of data flows, provide support in case of issues and closely monitor data quality.
- Collaborate with worldwide and local stakeholders on the big data platform to ensure data consistency, reusability and sharing.
- Participate to definitions and documentation of data pipelines
What you will be equipped with:
- At least 3+ years’ experience in Big Data / Business Intelligence / Data Warehousing
- Advanced knowledge in data integration from both internal sources and external APIs
- Advanced knowledge in data modeling and performance improvements in a big data ecosystem
- Mastery of Hadoop environments (HDFS, Hive, Spark)
- Expert in SQL, in particular on a large volume of data (query optimization);
- Proficient in Python and/ or Scala
- Previous experience with Big Data technologies such as Airflow, Kafka, Streamset
- Familiar with software engineering best practices, development and design
- Familiar with DevOps best practices, Docker and Kubernetes is a plus
- Good communication skills in English and Chinese
职位描述
· 与数据分析师密切合作,了解他们的需求,并根据现有架构和***实践设计最优的解决方案。
· 设计和开发易于理解和使用的数据模型,且对各种分析具有很强的可重复性。
· 设计和开发最优数据流(ETL)和进程,以实现快速高效的数据分析。
· 确保数据流的良好性能,在出现问题时给予支持,并密切监测数据质量。
· 在大数据平台上与全球和当地的利益相关者合作,确保数据的一致性、可重用性和共享。
· 参与数据管道的定义和文件编制。
岗位要求
· 在大数据/商业智能/数据仓库方面的拥有至少三年以上的工作经验。
· 充分了解来自内部渠道和外部API的数据集成。
· 充分了解大数据生态系统中的数据建模和性能改进。
· 掌握Hadoop环境(HDF、Hive、Spark)。
· 精通SQL,特别是大量数据(查询优化)。
· 精通Python和(或)Scala。
· 拥有在大数据技术方面的经验,如Airflow、Kafka、Streamset。
· 熟悉软件工程的使用、开发和设计。
· 熟练使用DevOps,能够使用Docker和Kubernetes者优先。
· 良好的中英文沟通能力。
公司介绍
About Ubisoft & Shanghai Studio:
Ubisoft’s 19,000 team members, working across more than 40 locations around the world, are bound by a common mission to enrich players’ lives with original and memorable gaming experiences. Their dedication and talent has brought to life many acclaimed franchises such as Assassin’s Creed, Far Cry, Watch Dogs, Just Dance, Rainbow Six, and many more to come.
Ubisoft is an equal opportunity employer that believes diverse backgrounds and perspectives are key to creating worlds where both players and teams can thrive and express themselves. If you are excited about solving game changing challenges, cutting edge technologies and pushing the boundaries of entertainment, we invite you to join our journey and help us create the unknown.
Created in 1996, Ubisoft Shanghai studio, is a vibrant and exciting place where our 600+ talents get opportunities to either co-develop great AAA blockbuster games, create cutting-edge online games or produce fun mobile games.
Ubisoft’s 19,000 team members, working across more than 40 locations around the world, are bound by a common mission to enrich players’ lives with original and memorable gaming experiences. Their dedication and talent has brought to life many acclaimed franchises such as Assassin’s Creed, Far Cry, Watch Dogs, Just Dance, Rainbow Six, and many more to come.
Ubisoft is an equal opportunity employer that believes diverse backgrounds and perspectives are key to creating worlds where both players and teams can thrive and express themselves. If you are excited about solving game changing challenges, cutting edge technologies and pushing the boundaries of entertainment, we invite you to join our journey and help us create the unknown.
Created in 1996, Ubisoft Shanghai studio, is a vibrant and exciting place where our 600+ talents get opportunities to either co-develop great AAA blockbuster games, create cutting-edge online games or produce fun mobile games.
联系方式
- Email:Sha-Recruitment@ubisoft.com
- 公司地址:上海徐汇区桂箐路7号G7园区3号楼3楼