Skills:
Infra Architect, Terraform, Python, Azure,Snowflake – Specialist on data platforms
- Great hands-on experience with Databricks platform. Extensive experience in PySpark coding.
- Excellent written and verbal communication, intellectual curiosity, a passion to understand and solve problems, consulting & customer service
- Structured and conceptual mindset coupled with strong quantitative and analytical problem-solving aptitude
- Exceptional interpersonal and collaboration skills within a team environment
Responsibilities:
- Design, develop, and deploy Databricks jobs to process and analyze large volumes of data.
- Collaborate with data engineers and data scientists to understand data requirements and implement appropriate data processing pipelines.
- Optimize Databricks jobs for performance and scalability to handle big data workloads.
- Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
- Implement best practices for data management, security, and governance within the Databricks environment