Python/Pyspark developer

Responsibilities:

• Development of microservices based on Python, Pyspark, AWS EKS, AWS Postgres for a data-oriented modernization project
• New System: Python and PySpark, AWS Postgres DB, Behave/Cucumber for automation, and Pytest
• Perform System, functional and data analysis on the current system and create technical/functional requirement documents.
• Current System: Informatica, SAS, AutoSys, DB2
• Write automated tests using Behave/cucumber, based on the new micro-services-based architecture
• Promote top code quality and solve issues related to performance tuning and scalability.

Requirements:

• Strong skills in DevOps, Docker/container-based deployments to AWS EKS using Jenkins and experience with SonarQube and Fortify
• Able to communicate and engage with business teams and analyze the current business requirements (BRS documents) and create necessary data mappings.
• Preferred strong skills and experience in reporting applications development and data analysis.
• Knowledge in Agile methodologies and technical documentation.
• Nice to Have: Informatica, SAS, Snowflake, AMQ’s, AWS, Kubernetes/Amazon EKS, Java, Sprint Boot, AutoSys, DB2, and Tableau
• Strong project planning and execution management skills, including
• Timeline and critical path management
• Issues identification and resolution
• Dashboard and status reporting
• Must Have Qualifications: Python and PySpark, AWS Postgres DB, Cucumber for automation, AWS EKS, Jenkins, SonarQube and Fortify.
• Preferred: Snowflake, AMQ’s, AWS, Kubernetes/Amazon EKS, Java, Sprint Boot, Informatica, SAS, AutoSys, DB2