Big Data Engineer

Responsibilities

• Meet project objectives, providing systems that operate in a cost-effective manner.
• Respond to problems in a timely, effective manner.
• Work with key members of the management team to define and drive technical strategy.
• Stay abreast of advancements in eCommerce technologies in order to determine relevance and possible impact to existing system.

Required Skills

• Proficiency with HDFS and MapReduce is preferred.
• Knowledge of machine learning/distributed systems is preferred.
• Knowledge of Front store/customer loyalties program is preferred.
• Good Communication skills, interpersonal skills and analytical skills.

Required Experience

• 5+ years of programming language experience required, preferably in Python and PySpark.
• 3+ years of Enterprise experience designing, building and operating in-production big data/stream processing and/or enterprise data warehouse is required.
• 2+ year of experience with Apache Spark/Storm and NoSQL storage is preferred.
• Experience with big data platforms is preferred.
• Experience handling data with Databricks.

Education Requirements

• Bachelor’s Degree in Computer Science, Computer Engineering or a closely related field.