Spark Developer

Responsibilities

• Participate in the entire software development lifecycle by writing and executing test plans, finding solutions to issues during development and after deployment.
• Team up with architects, scrum masters, leads, managers and directors, you will work in an Agile environment to make the data on the Big Data Platform accessible for the needs of the organization through Atomic Models and Analytical Data Stores.
• Should be intellectually curious, have a solutions-oriented attitude and enjoy learning new tools and techniques.
• Create the high-level design artifacts.
• Deliver high quality code deliverables for a module, lead validation for all types of testing and support activities related to implementation, transition and warranty. You will be part of a learning culture, where teamwork and collaboration are encouraged, excellence is rewarded, and diversity is respected and valued.

Required Skills

• Strong written and oral communication skills.
• Ability to work in team in diverse/ multiple stakeholder environment.
• Ability to communicate complex technology solutions to diverse teams namely, technical, business and management teams.
• Strong knowledge and hands-on experience in SQL, Unix shell scripting.
• Knowledge and experience with full SDLC lifecycle.

Required Experience

• At least 4 years of experience with Information Technology.
• At least 4 years of experience in software development life cycle.
• Experience in preparing test scripts and test cases to validate data and maintaining data quality.
• At least 3 years of experience in Project life cycle activities on development and maintenance projects.
• At least 1 year of experience in Relational Modeling, Dimensional Modeling and Modeling of Unstructured Data.
• Good experience in end-to-end implementation of DW BI projects, especially in data warehouse and mart developments.
• Experience with Lean / Agile development methodologies.
• At least 2 years of experience in Hadoop ecosystem, i.e. Hadoop, Hbase, Hive, Scala, SPARK, Sqoop, Flume, Kafka and Python.
• Good experience in end-to-end implementation of DW BI projects, especially in data warehouse and mart developments.

Education Requirements

• Bachelor’s Degree in Computer Science, Computer Engineering or a closely related field.