Description

  • ROLES AND RESPONSIBILITIES
    • Participate in technical planning & requirements gathering phases including design, coding, testing, troubleshooting, and documenting big data-oriented software applications. Responsible for the ingestion, maintenance, improvement, cleaning, and manipulation of data in the business’s operational and analytics databases, and troubleshoots any existent issues.
    • Implements, troubleshoots, and optimizes distributed solutions based on modern big data technologies like Hive, Hadoop, Spark, Elastic Search, Storm, Kafka, etc. in both an on premise and cloud deployment model to solve large scale processing problems.
    • Define and build large-scale near real-time streaming data processing pipelines that will enable faster, better, data-informed decision making within the business.
    • Work inside the team of industry experts on the cutting edge Big Data technologiesto develop solutions for deployment at massive scale.
    • Study data, identify patterns, make sense out of it and convert it to algorithms.
    • Designs and plans BI, and other Visualization Tools capturing and analyzing data from multiple sources to make data-driven decisions, as well as debugs, monitors, and troubleshoots solutions.
    • Keep up with industry trends and best practices, advising senior management on new and improved data engineering strategies that will drive departmental performance leading to improvement in overall improvement in data governance across the business, promoting informed decision-making, and ultimately improving overall business performance.
  • SKILLS AND EXPERIENCES
    • Programming languages: Java, Python MUST. Good to have a knowledge of C
    • Experience with Hadoop development and QA
    • Experience with NFS (preferably ONTAP) and shared file systems development
    • Experience with Hortonworks technologies and Cloudera technologies
    • Knowledge of Hadoop ecosystem components like MapReduce, Spark, HBase and, Ranger and Sentry.
    • Security framework experience with Kerberos, LDAP

Key Skills
Education

Any Graduate

Back To Jobs