Databricks Admin with AWS

Responsibilities:

• Databricks Platform Infrastructure: Design, build, and maintain data infrastructure on the Databricks Platform, including Spark and Databricks SQL.
• Data Team Enablement: Provide technical expertise and support to Data Scientists, Data Engineers, and Analysts, enabling them to effectively utilize the Databricks platform.
• Performance Optimization: Optimize Databricks workloads for performance, scalability, and cost efficiency.
• Infrastructure as Code (IaC): Implement and manage infrastructure using IaC tools such as Terraform or CloudFormation.
• Security and Governance: Implement and maintain security and governance best practices for the Databricks platform.
• Monitoring and Troubleshooting: Monitor the health and performance of the Databricks infrastructure and troubleshoot and resolve technical issues.
• Best Practices: Develop and document best practices for Databricks platform management.

Minimum Qualifications:

• Extensive hands-on experience with the Databricks Platform, including Delta Lake, Spark, and Databricks SQL.
• Proven experience in building and maintaining cloud-based data infrastructure, preferably on AWS.
• Strong understanding of data warehousing, data lake, and data engineering concepts.
• Demonstrated experience supporting Data Scientists, Data Engineers, and Analysts.
• Proficiency in Infrastructure as Code (IaC) tools. Preferably Terraform.
• Experience with data pipelines, ETL/ELT processes, and data modeling.
• Strong problem-solving and troubleshooting skills.
• Excellent communication and collaboration skills