Lead Devops (Databricks) Engineer

Design, implement, and manage Databricks clusters, ensuring high availability and performance.

• Automate cloud infrastructure provisioning using Terraform and ensure infrastructure as code (IaC) best practices.

• Optimize resource allocation and cost management in cloud environments (AWS, Azure, or GCP).

• Build and maintain CI/CD pipelines using tools like Jenkins, GitHub Actions, GitLab CI/CD, or Azure DevOps.

• Automate deployment, scaling, and monitoring of microservices and applications.

• Write Python scripts for automating DevOps tasks, including cloud resource provisioning, monitoring, and log analysis.

• Develop automation workflows for MuleSoft API deployments and integrations.

• Set up monitoring tools like Prometheus, Grafana, Datadog, or Splunk to track system performance and log management.

• Conduct incident response and troubleshooting for production environments.

• Work closely with development, data engineering, and IT teams to improve DevOps workflows.

Job Requirements -   

• 12 plus years of experience as a platform engineer

• Design, implement, and manage Databricks clusters, ensuring high availability and performance.

• Automate cloud infrastructure provisioning using Terraform and ensure infrastructure as code (IaC) best practices.

• Optimize resource allocation and cost management in cloud environments (AWS, Azure, or GCP).

• Build and maintain CI/CD pipelines using tools like Jenkins, GitHub Actions, GitLab CI/CD, or Azure DevOps.

• Automate deployment, scaling, and monitoring of microservices and applications.

• Write Python scripts for automating DevOps tasks, including cloud resource provisioning, monitoring, and log analysis.

• Develop automation workflows for MuleSoft API deployments and integrations.

• Set up monitoring tools like Prometheus, Grafana, Datadog, or Splunk to track system performance and log management.

• Conduct incident response and troubleshooting for production environments.

• Work closely with development, data engineering, and IT teams to improve DevOps workflows.

• Define best practices for infrastructure, deployment, and cloud governance.

• Provide mentorship and training to junior DevOps engineers.

Desired Skills & Experience -   

• Define best practices for infrastructure, deployment, and cloud governance.

• Provide mentorship and training to junior DevOps engineers