UNIX SHELL SCRIPTING

JD:-

· Design, automation, automated test scripts and frameworks for a broad spectrum of data platforms.

· Develop comprehensive automation development through Unix shell scripts, creating detailed test cases, and Improving system efficiency by optimizing the shell scripts.

· Data quality testing, ensuring the accuracy and integrity of data exist in Hadoop platform, as well as conducting performance testing to optimize application efficiency.

· Diagnosing and fixing system issues using shell scripts.

· Documenting system changes and updates for future reference.

· Collaborate closely with data platform teams, this role will contribute to automation, testing efforts, ensuring seamless operation in the Hadoop data platform.

· Regression testing will be a key aspect of this role, ensuring the stability of Hadoop platforms across releases in an Agile framework.

You'll be taking charge of automating tasks, enhancing system performance, and developing scripts to streamline our operations.

Requirements and Skills

· Proven experience as a Shell Developer or similar role.

· Proficiency in shell scripting languages like Bash, Perl, or Python.

· Strong knowledge of Linux/Unix operating systems.

· Solid understanding of Hadoop ecosystem components, including HDFS, MapReduce, Hive, Kafka, Spark, Docker, etc. required.

· Excellent problem-solving skills and attention to detail.

· Ability to work in a fast-paced environment and manage multiple tasks.

· Familiarity with version control systems and continuous integration / continuous deployment (CI/CD) pipelines.

· Excellent problem-solving and analytical skills.

· Effective communication and collaboration skills will be vital when working with cross-functional teams, providing timely feedback on defects and improvements.