Description


Job Description

Migrating python based ETL jobs to Databricks

Roles & Responsibilities

1. Migrate underlying Looker views to Spark ETL jobs on databricks. Each of these views will have a corresponding table in our Datalake, that is updated by the ETL jobs on a regular basis.

 

2. Work with our team to QA these new tables and ensure data quality.

Eligibility

Mandatory Skills:- PySpark, AWS, SQL, DWH , DataBricks, Good Communication skill

Education

Bachelor's degree in Computer Science