Job Description:
-Extensive experience in building, managing, and optimizing data pipelines and solutions on Azure Databricks
-Strong expertise in PySpark, Python, SQL, Unity Catalog
-Microservices & API Design: Experienced in designing scalable, loosely coupled architectures.
-Data & AI Strategy: Skilled in integrating data management and AI/ML components into architectural designs
-10+ years of experience in data engineering or a related field.
-Strong hands-on experience with Azure Databricks and other Azure native services including Purview, Synapse and Power BI.
-Proficiency in PySpark and Python for large-scale data processing.
-Experience with Unity Catalog for managing data governance and access control.
-Understanding of data modelling concepts and ETL/ELT workflows.
Any Graduate