Senior Spark Developer

Responsibilities

• Contribute to complex design solutions helping Data Architects for re-design of Scala Scripts
• Mentor and guide junior team members at client site as well as offshore.
• Formulate and define system scope and objectives for assigned projects.
• Develop appropriate software solutions to requests for new services and functionality.
• Develop detailed specifications, application coding, unit and systems testing for the IT department.
• Examine, devise and modify procedures to solve moderately complex problems in regard to existing system capabilities, operating time or the form of desired results.
• Coordinate and support software production schedules and processing.

Required Skills

• Client Web Technologies using JavaScript and its frameworks.
• Strong hands on knowledge of Spark and Hadoop ecosystem.
• Extensive knowledge of Docker and Kubernetes.
• Some working knowledge of DevSecOps would be advantageous.
• Good knowledge of Agile, Scrum.
• Strong verbal and written communication skills.
• Strong Analytical skills and should demonstrate problem solving skills.
• Must be willing to learn new technologies and tools and scale up very quickly on the job.

Required Experience

• Strong Hands-On experience on Spark with Java API, Kafka, AWS EMR experience.
• Extensive experience with AWS Cloud based technology.
• Experience in working big data technologies like Hive, HBase, Spark, Scala, Hue, Kafka etc.
• Experience working with Java Technologies and good understanding Hands on experience with YARN Spark with relevant experience is fine tuning optimizing SPARK applications.
• Solid experience with Spark.

Education Requirements

• Bachelor’s Degree in Computer Science, Computer Engineering or a closely related field.