Job Description:
We are seeking an experienced Azure Data Engineer to design, develop, and optimize data solutions on the Azure cloud platform. The ideal candidate should have a minimum of good years of experience in Azure data engineering and expertise in building scalable and efficient data pipelines.
Key Responsibilities:
Design and implement end-to-end data pipelines using Azure Data Factory, Databricks, and PySpark.
Develop and maintain data integration, transformation, and processing workflows for large-scale datasets.
Work with Python and SQL to create efficient data models, queries, and ETL processes.
Optimize performance, security, and cost-efficiency of Azure-based data solutions.
Collaborate with data analysts, business teams, and other stakeholders to deliver high-quality data solutions.
Ensure compliance with best practices in data governance, security, and performance optimization.
Key Skills & Technologies:
Data Engineering & ETL Development
Azure Data Factory (ADF)
Azure Databricks & PySpark
Python & SQL
Cloud Data Storage & Processing (Azure Data Lake, Synapse Analytics, etc.)
Performance Optimization & Data Governance
Any Graduate