Description

Qualifications:

  • 3+ years of relevant experience in Pyspark and Azure Databricks.
  • Proficiency in integrating, transforming, and consolidating data from various structured and unstructured data sources.
  • Good experience in SQL or native SQL query languages.
  • Strong experience in implementing Databricks notebooks using Python.
  • Good experience in Azure Data Factory, ADLS, Storage Services, Serverless architecture, Azure functions.
  • Experience in SSIS/ETL transformation processes.
  • Experience in Azure DevOps and CI/CD deployments
  • DP-203 certification

Essential Skills:

  • Create Databricks notebook to process data
  • Work on integrating and consolidating data from multiple sources and load to ADLS
  • Understanding the customer needs

Desirable Skills:

  • Good information and sound knowledge in Azure Databricks, Azure Data Factory

Education

Any Gradute