上海招聘

Responsibilities

• Create and maintain optimal data pipeline architecture.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
• Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
• Work with data and analytics experts to strive for greater functionality in our data systems.

Qualifications

(Must have)

• BS or above in Computer Science, Information Science or related field.
• 3+ years of experience in product development.
• Experience with object-oriented/object function scripting languages: Python, Java, Scala, etc.
• Experience with Linux operating system and Shell script.
• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
• Experience with big data tools: Hadoop, YARN, HDFS, Spark, Impala, etc.
• Experience with human-readable data-serialization languages: YAML, JSON, XML, etc.
• Experience building and optimizing data pipelines, architectures and data sets using Hadoop ecosystem tools.
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Experience supporting and working with cross-functional teams in a dynamic environment.
• A strong self-starter and a problem-solver
• Excellent communication skills and team player

(Nice to have)

• Experience with NoSQL databases, including MongoDB, HBase, and Cassandra.
• Experience with docker/container, Kubernetes and Microservices.
• Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
• Experience with stream-processing systems: Kafka, Spark-Streaming, etc.

ElectrifAi

Formerly Opera Solutions. Transforming chaotic data into practical insights through Practical AI solutions since 2004.

With over 16 years of experience in AI and ML, our customers know ElectrifAi is the trusted expert to help them transform their businesses. Many of the world’s largest enterprise and government customers trust us to access their complex, chaotic distributed data and make sense of it, translating it into insights that propel the business through improved profit, performance or reduced risk. We’ve positively impacted the world’s top industries including Government, Healthcare, Financial Services, Travel and Hospitality, Telecommunications, CPG, Retail and Entertainment. Because our engineering approach fully embraces pre-packaged reusable component logic built on open-source technology (such as spark and containers), we stand up solutions quicker than any of our competition. That’s practical AI and rapid ROI. That’s ElectfriAi.