Description

Key Skills: Data Engineer, Azure ADF, SQL, Python

Roles and Responsibilities:

  • Design, build, and optimize scalable data pipelines and dataflows in Azure Data Factory / Azure Synapse following the Medallion Architecture (Bronze, Silver, Gold layers).
  • Develop and manage data ingestion processes from diverse sources into Azure Data Lake.
  • Implement and optimize data transformations using PySpark / Databricks.
  • Work with SQL Server to build and maintain structured data storage, queries, and stored procedures.
  • Develop and support Power BI dashboards to deliver business insights.
  • Ensure best practices in data governance, data quality, and security.
  • Collaborate with business stakeholders, analysts, and other engineers to understand data needs and deliver solutions.
  • Monitor and troubleshoot data pipelines, ensuring high availability and performance.

Skills Required:

Must-Have:

  • Data engineering expertise (designing, building, and maintaining data pipelines)
  • Experience with Azure Data Factory / Azure Synapse
  • SQL Server for data storage, queries, and stored procedures
  • Knowledge of Medallion Architecture (Bronze, Silver, Gold layers)
  • Data modeling and transformation skills
  • Power BI dashboard development
  • Data governance, quality, and security practices

Nice-to-Have:

  • Python programming for ETL and data processing
  • PySpark / Databricks for large-scale transformations
  • Experience with Azure Data Lake ingestion processes
  • Collaboration with business stakeholders and analysts

Education: Bachelor's or Master's degree in Computer Science, Information Technology, Data Engineering, or a related field

Key Skills
Education

Any Graduate

Back To Jobs