Big Data Engineer

We are looking for energetic, high-performing and highly skilled Engineers to help shape our technology and product roadmap. You will be part of the fast-paced, entrepreneurial Enterprise Personalization portfolio focused on delivering the next generation global marketing capabilities. This team is responsible for Global campaign tracking of new accounts acquisition and bounty payments and leverages transformational technologies, such as SQL, Hadoop, Spark, Pyspark, HDFS, MapReduce, Hive, HBase, Kafka & Java.

Focus: Designs, develops, solves problems, debugs, evaluates, modifies, deploys, and documents software and systems that meet the needs of customer-facing applications, business applications, and/or internal end user applications. Develop maintain large data processing pipeline using Pyspark and SQL

Roles & Responsibilities
Responsibilities

• Function as member of an agile team by contributing to software builds through consistent development practices (tools, common components, and documentation) • Develops and tests software, including ongoing refactoring of code, and drives continuous improvement in code structure and quality • Primary focus is spent writing code, conducting code reviews and testing in ongoing sprints, or doing proof of concepts/automation tools. Applies visualization and other techniques to fast track concepts. • Debug basic software components and identify code defects for remediation • Enable the deployment, support, and monitoring of software across test, integration, and production environments

Minimum Qualifications:

This high energy Engineer must have: • A Bachelor’s degree in computer science, computer engineering, other technical discipline, or equivalent work experience • 6 – 9 years of software development experience. Hands-on expertise with application design, software development, and automated testing. • Strong programming knowledge in SQL, Pyspark, Data processing • Hands-on experience in Big Data technologies (Spark, Hive, MapReduce and Hbase) • Understanding and experience with UNIX / Shell / Perl / Python scripting •Database query optimization and indexing • Web services design and implementation using REST / SOAP and Java is a plus • Experience collaborating with the business to drive requirements/Agile story analysis. • Experience with design and coding across one or more platforms and languages as appropriate