Machine Learning Engineer with Pyspark

Responsibilities

• Act as the ML Engineering Lead to manage the production, delivery, and integration of the solution within the business.
• Solution and develop architecture for model evaluation and model serving infrastructure.
• Investigate areas of the business that could benefit from machine learning solutions, engaging with technology and operational leaders to understand the problems they are looking to solve, as well as educating them on what is an achievable outcome.
• Work with a team of world class data scientists, business analysts, statisticians, and creative technologists.
• Implement in production machine learning systems using Python, R, and AWS.

Required Skills

• Strong background of creating data processing and model deployment pipelines (Apache Airflow, Apache Beam, PySpark, Amazon Pipeline).
• Advanced knowledge of Linux (bash), Python, and SQL (MySQL, PostgreSQL).
• Good knowledge of Pyspark, Spark ML, sklearn, pandas etc.
• Good understanding of Hadoop ecosystem.
• Knowledge of software development principles including but not limited to, software development lifecycle, agile methodologies, code reviews.
• Working understanding of core ML/Statistics principles.

Required Experience

• 2+ years of experience or exposure to applications of machine learning.
• Experience on Model deployment & MLOps.
• Strong SQL/Hive QL experience.
• Good hands-on experience with Unix.
• Good experience on ML Pipeline creation.

Education Requirements

• Bachelor’s Degree in Computer Science, Computer Engineering or a closely related field.