Pyspark Developer

Required SkillsPython, PySpark, SQL, AWS... This team is moving from on-prem to AWS. They are currently a Hadoop environment working with SSIS but are using Python & PySpark for the transition to AWS Glue. They can train on Glue if needed but AWS is the environment.

JOB DESCRIPTION

At least 3 years of experience in ETL development (Pyspark).

At least 5 years of experience writing SQL queries, troubleshooting.

Star Schema design and coding (Dimension and Fact Table design)

Understanding of enterprise data warehousing best practices and standards.

Good communication and interpersonal skills.

Good organization skills and the ability to work independently as well as with a team.