Description
- Design, build, and maintain CI/CD pipelines for Azure Data Factory and Databricks notebooks.
- Automate unit, integration, and QA testing workflows in Databricks.
- Implement and manage CI/CD pipelines for schema updates, leveraging strong data architecture skills.
- Develop and maintain Azure DevOps Pipelines using YAML builds and release workflows.
- Write and maintain scripts using Python, PowerShell, and Terraform for automation and infrastructure management.
- Utilize Azure services, including ADF, Databricks, DABs, ADLS Gen2, Key Vault, and Azure DevOps (ADO).
- Apply infrastructure-as-code best practices to manage and provision cloud resources.
- Collaborate with Data Engineers and Platform teams to support development, staging, and production environments.
- Monitor, troubleshoot, and resolve pipeline failures and deployment inconsistencies.
- Ensure the reliability and scalability of data pipelines and deployment processes
Education
Any Gradute
- Posted On: 30+ Days Ago
- Experience: 12+ years of experience
- Openings: 1
- Category: Azure Devops Engineer
- Tenure: Full-Time Position