Azure Data Factory Architect

Key Responsibilities
· Lead consulting and advisory on Azure Data Factory (ADF) pipeline design and implementation, ensuring alignment with business-as-usual (BAU) operations.
· Architect and implement robust ADF pipelines with a focus on API integration, authentication, and end-to-end security best practices.
· Collaborate with stakeholders to translate business requirements into scalable ADF solutions, optimizing for maintainability and operational efficiency.
· Provide expert guidance on ADF features, troubleshooting, and continuous improvement of data workflows in production environments.
· Mentor teams on secure ADF pipeline development, API management, and compliance with enterprise security standards.

Required Qualifications
Technical Expertise:
· Strong expertise in Azure Data Factory, including pipeline design, data flow, and integration runtime configuration.
· Proficiency in Azure cloud services such as Azure Data Lake, Azure Synapse Analytics, Azure SQL Database, and Azure Key Vault.
· Hands-on experience with ETL/ELT processes, data transformation, and data integration patterns.
Programming and Scripting:
· Proficiency in SQL, Python, or other scripting languages for data manipulation and automation.
· Experience with REST APIs and integrating ADF with external systems.

Architectural Knowledge:
· Deep understanding of cloud-based data architecture, including data lakes, data warehouses, and real-time data processing.
· Familiarity with DevOps practices, CI/CD pipelines, and Infrastructure as Code (IaC) using tools like Azure DevOps, ARM templates, or Terraform