大数据架构师
安永全球商务服务(大连)有限公司
- 公司规模:500-1000人
- 公司性质:外资(欧美)
- 公司行业:专业服务(咨询、人力资源、财会)
职位信息
- 发布日期:2021-01-14
- 工作地点:大连
- 招聘人数:2人
- 工作经验:5-7年经验
- 学历要求:本科
- 职位月薪:1.5-2万/月
- 职位类别:Hadoop工程师
职位描述
As part oAs part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest value and discover opportunities in key business and functions like Banking, Insurance, Manufacturing, Healthcare, Retail, Manufacturing and Auto, Supply Chain, and Finance.
The opportunity
We’re looking for SENIORs (Big Data Architects) with strong technology and data understanding having proven delivery capability. This is a fantastic opportunity to be part of a leading firm as well as a part of a growing Data and Analytics team.
Your key responsibilities
- Develop standardized practices for delivering new products and capabilities using Big Data technologies, including data acquisition, transformation, and analysis.
- Interact with client technology leaders, understand their business goals, create, architect, propose, develop and deliver technology solutions
- Define and develop client specific best practices around data management within a Hadoop environment on Alicloud
- Recommend design alternatives for data ingestion, processing and provisioning layers
- Design and develop data ingestion programs to process large data sets in Batch mode using HIVE, Pig and Sqoop technologies
- Develop data ingestion programs to ingest real-time data from live sources using Apache Kafka, Spark Streaming and related technologies
Skills and attributes for success
- Strong understanding & familiarity with all Hadoop Ecosystem components and Hadoop Administrative Fundamentals
- Strong understanding of underlying Hadoop Architectural concepts and distributed computing paradigms
- Experience in the development of Hadoop APIs and MapReduce jobs for large scale data processing.
- Hands-on programming experience in Apache Spark using SparkSQL and Spark Streaming or Apache Storm
- Hands on experience with major components like Hive, PIG, Spark, MapReduce
- Experience working with NoSQL in at least one of the data stores - HBase, Cassandra, MongoDB
- Experienced in Hadoop clustering and Auto scaling.
- Good knowledge in apache Kafka & Apache Flume
- Knowledge of Spark and Kafka integration with multiple Spark jobs to consume messages from multiple Kafka partitions
- Knowledge of Apache Oozie based workflow
- Hands-on expertise in Alibaba cloud services is expected, and experience of other cloud platforms such as AWS, and/or Microsoft Azure would be an additional advantage
- Certifications in data integration tooling, including Alibaba Cloud Big Data, Informatica, Talend, Azure Data Factory or equivalent would be welcome
- Solid understanding of ETL methodologies in a multi-tiered stack, integrating with Big Data systems like Hadoop and Cassandra.
- Experience with BI, and data analytics databases
- Experience in converting business problems/challenges to technical solutions considering security, performance, scalability etc.
- Experience in Enterprise grade solution implementations.
- Knowledge in Big data architecture patterns [Lambda, Kappa]
- Experience in performance bench marking enterprise applications
- Experience in Data security [on the move, at rest]
- Strong UNIX operating system concepts and shell scripting knowledge
To qualify for the role, you must have
- Flexible and proactive/self-motivated working style with strong personal ownership of problem resolution
- Excellent communicator (written and verbal formal and informal)
- Ability to multi-task under pressure and work independently with minimal supervision
- Strong verbal and written communication skills in Mandarin and English. Experience of Cantonese would be beneficial
- Must be a team player and enjoy working in a cooperative and collaborative team environment.
- Adaptable to new technologies and standards
- Participate in all aspects of Big Data solution delivery life cycle including analysis, design, development, testing, production deployment, and support
- Minimum 5 years hand-on experience in one or more of the above areas.
- Minimum 5 years industry experience
Ideally, you’ll also have
· Project management skills
- Client management skills
- Solutioning skills
What we look for
- People with technical experience and enthusiasm to learn new things in this fast-moving environment
What working at EY offers
At EY, we’re dedicated to helping our clients, from start–ups to Fortune 500 companies — and the work we do with them is as varied as they are.
You get to work with inspiring and meaningful projects. Our focus is education and coaching alongside practical experience to ensure your personal development. We value our employees and you will be able to control your own development with an individual progression plan. You will quickly grow into a responsible role with challenging and stimulating assignments. Moreover, you will be part of an interdisciplinary environment that emphasizes high quality and knowledge exchange. Plus, we offer:
- Support, coaching and feedback from some of the most engaging colleagues around
- Opportunities to develop new skills and progress your career
- The freedom and flexibility to handle your role in a way that’s right for you
f our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest value and discover opportunities in key business and functions like Banking, Insurance, Manufacturing, Healthcare, Retail, Manufacturing and Auto, Supply Chain, and Finance.
The opportunity
We’re looking for SENIORs (Big Data Architects) with strong technology and data understanding having proven delivery capability. This is a fantastic opportunity to be part of a leading firm as well as a part of a growing Data and Analytics team.
Your key responsibilities
- Develop standardized practices for delivering new products and capabilities using Big Data technologies, including data acquisition, transformation, and analysis.
- Interact with client technology leaders, understand their business goals, create, architect, propose, develop and deliver technology solutions
- Define and develop client specific best practices around data management within a Hadoop environment on Alicloud
- Recommend design alternatives for data ingestion, processing and provisioning layers
- Design and develop data ingestion programs to process large data sets in Batch mode using HIVE, Pig and Sqoop technologies
- Develop data ingestion programs to ingest real-time data from live sources using Apache Kafka, Spark Streaming and related technologies
Skills and attributes for success
- Strong understanding & familiarity with all Hadoop Ecosystem components and Hadoop Administrative Fundamentals
- Strong understanding of underlying Hadoop Architectural concepts and distributed computing paradigms
- Experience in the development of Hadoop APIs and MapReduce jobs for large scale data processing.
- Hands-on programming experience in Apache Spark using SparkSQL and Spark Streaming or Apache Storm
- Hands on experience with major components like Hive, PIG, Spark, MapReduce
- Experience working with NoSQL in at least one of the data stores - HBase, Cassandra, MongoDB
- Experienced in Hadoop clustering and Auto scaling.
- Good knowledge in apache Kafka & Apache Flume
- Knowledge of Spark and Kafka integration with multiple Spark jobs to consume messages from multiple Kafka partitions
- Knowledge of Apache Oozie based workflow
- Hands-on expertise in Alibaba cloud services is expected, and experience of other cloud platforms such as AWS, and/or Microsoft Azure would be an additional advantage
- Certifications in data integration tooling, including Alibaba Cloud Big Data, Informatica, Talend, Azure Data Factory or equivalent would be welcome
- Solid understanding of ETL methodologies in a multi-tiered stack, integrating with Big Data systems like Hadoop and Cassandra.
- Experience with BI, and data analytics databases
- Experience in converting business problems/challenges to technical solutions considering security, performance, scalability etc.
- Experience in Enterprise grade solution implementations.
- Knowledge in Big data architecture patterns [Lambda, Kappa]
- Experience in performance bench marking enterprise applications
- Experience in Data security [on the move, at rest]
- Strong UNIX operating system concepts and shell scripting knowledge
To qualify for the role, you must have
- Flexible and proactive/self-motivated working style with strong personal ownership of problem resolution
- Excellent communicator (written and verbal formal and informal)
- Ability to multi-task under pressure and work independently with minimal supervision
- Strong verbal and written communication skills in Mandarin and English. Experience of Cantonese would be beneficial
- Must be a team player and enjoy working in a cooperative and collaborative team environment.
- Adaptable to new technologies and standards
- Participate in all aspects of Big Data solution delivery life cycle including analysis, design, development, testing, production deployment, and support
- Minimum 5 years hand-on experience in one or more of the above areas.
- Minimum 5 years industry experience
Ideally, you’ll also have
· Project management skills
- Client management skills
- Solutioning skills
What we look for
- People with technical experience and enthusiasm to learn new things in this fast-moving environment
What working at EY offers
At EY, we’re dedicated to helping our clients, from start–ups to Fortune 500 companies — and the work we do with them is as varied as they are.
You get to work with inspiring and meaningful projects. Our focus is education and coaching alongside practical experience to ensure your personal development. We value our employees and you will be able to control your own development with an individual progression plan. You will quickly grow into a responsible role with challenging and stimulating assignments. Moreover, you will be part of an interdisciplinary environment that emphasizes high quality and knowledge exchange. Plus, we offer:
- Support, coaching and feedback from some of the most engaging colleagues around
- Opportunities to develop new skills and progress your career
- The freedom and flexibility to handle your role in a way that’s right for you
公司介绍
安永商务服务在2010年获得IS09001认证,以及获大连市政府相关部委分别认定为技术先进型服务企业和服务外包企业,充分证明安永商务服务在外包服务领域处于先进的水平。秉承安永全球企业文化---领先的以人为本的企业文化, 安永全球商务服务(大连)有限公司也一直把吸引***的人员,培养企业员工以及表彰员工的进步以及发展做为公司的企业文化以及经营宗旨,为员工提供各种培训机会以及转岗、晋升的空间。
EY Global Shared Services (Dalian) Co. Ltd (GSS Dalian), founded on June 19, 2009, is one of the member firms of Ernst & Young Global Limited, and Ernst & Young’s first GSS Center in China. With our leading expertise and extensive experience, we provide finance, HR,IT and other services to Ernst & Young offices in 19 countries and territories in the Asia-Pacific region.
GSS Dalian received IS09001 certification, Technologically Advanced Service Enterprise certification and Outsourcing Service Enterprise certification which were certificated by Dalian relevant departments respectively in 2010, fully demonstrating its leading position in outsourcing service. Carrying the people-leading corporate culture, GSS Dalian is always aiming to attract the best talents, offer training opportunities, reward employees, and provide opportunities for internal transfer and promotion.
联系方式
- 公司地址:地址:span大连市高新区火炬路3号纳米大厦14层