Description

  • Design, build, and maintain CI/CD pipelines for Azure Data Factory and Databricks notebooks.
  • Automate unit, integration, and QA testing workflows in Databricks.
  • Implement and manage CI/CD pipelines for schema updates, leveraging strong data architecture skills.
  • Develop and maintain Azure DevOps Pipelines using YAML builds and release workflows.
  • Write and maintain scripts using Python, PowerShell, and Terraform for automation and infrastructure management.
  • Utilize Azure services, including ADF, Databricks, DABs, ADLS Gen2, Key Vault, and Azure DevOps (ADO).
  • Apply infrastructure-as-code best practices to manage and provision cloud resources.
  • Collaborate with Data Engineers and Platform teams to support development, staging, and production environments.
  • Monitor, troubleshoot, and resolve pipeline failures and deployment inconsistencies.
  • Ensure the reliability and scalability of data pipelines and deployment processes

Key Skills
Education

Any Gradute

Back To Jobs