Job Description
Migrating python based ETL jobs to Databricks
Roles & Responsibilities
1. Migrate underlying Looker views to Spark ETL jobs on databricks. Each of these views will have a corresponding table in our Datalake, that is updated by the ETL jobs on a regular basis.
2. Work with our team to QA these new tables and ensure data quality.
Eligibility
Mandatory Skills:- PySpark, AWS, SQL, DWH , DataBricks, Good Communication skill
Bachelor's degree in Computer Science