Description

Responsibilities

  • Work with Data Analysts and other team members to review business requirements and translate into technical requirements.
  • Design and Build Data Integration pipeline using Cloudera Hadoop platform.
  • Transform the data to create a consumable data layer for various application uses.
  • Support Data pipeline with bug fixes, and additional enhancements.

Required Skills

  • Strong design and development skills for Java, Spring, Microservices, Automated testing.
  • Strong design and development skills for Hadoop, Spark ( Scala/python).
  • Strong SQL skills ( important).
  • Extremely fluent with UI development – Angular.
  • Good knowledge of CICD pipeline development.
  • Should be a self-starter and should be able to work with minimum supervision.

Required Experience

  • Experience with query tuning, application performance enhancement.
  • 2+ years in Hadoop technologies such as MapReduce, Hive, Sqoop, Oozie, Impala and other related Big Data technologies.
  • Must have extensive experience with Agile or Scrum methodologies.
  • Experience tuning various configuration parameters for optimal performance.
  • Advanced level experience with at least one NoSQL stores (Hbase, Cassandra, MongoDB etc) Hbase is highly preferred.
  • Must have strong experience in continuous integration within DevOps environment.

Education Requirements

  • Bachelor’s Degree in Computer Science, Computer Engineering or a closely related field.


 

Education

Any Graduate