Description

Key Responsibilities:

  • Design Implement and manage scalable and secure AWS Infrastructure for big data processing
  • Develop and maintain spark-based data processing pipelines using scala
  • implement Devops practices such as CICD and monitoring
  • collaborate with cross functional teams to ensure smooth deployment and operation of big data applications
  • troubleshoot and resolve issues related to Spark Scala and AWS

 

Technical Skills:

  • 5 - 10 Years of experience as Devops Engineer
  • Expertise in designing and implementing scalable AWS infrastructure including EC2, S3, EMR, RDS, Glue, Aethan
  • Strong experience with spark including spark core, spark SQL, and spark streaming
  • proficiency in scala libraries and frameworks
  • Experience with Devops tools such as Jenkins, GIT and Docker

Education

Any Gradute