Key Skills: Kafka,Cluster.
Roles & Responsibilities:
- Perform Kafka cluster build, including design, infrastructure planning, High Availability, and Disaster Recovery.
- Implement wire encryption using SSL, authentication using SASL/LDAP, and authorization using Kafka ACLs in Zookeeper.
- Create connect cluster and connector deployment.
- Maintain current Kafka clusters by performing upgrades, performance tuning, monitoring setup, and adding new features.
- Research new features and conduct proof of concept installations and testing.
- Collaborate with infrastructure, development, and administration teams to support Kafka in On-Premise, Cloud AWS, and Azure environments.
- Assist application teams with Kafka implementation and issue triage.
- Work with vendor partners to resolve cases and product vulnerabilities.
- Gather requirements from application teams and assist in the build path to production.
- Conduct performance and resiliency testing with application teams.
- Implement best practices and collaborate with product owners on the roadmap.
- Provision resources in AWS and/or Azure, including creating EC2 instances, EBS volumes, and security groups.
- Document best practices and maintain operational standards.
Experience Requirement:
- 11 - 13 years of experience in infrastructure engineering with strong hands-on expertise in Kafka architecture and administration.
- Deep experience in designing and maintaining large-scale Kafka clusters across hybrid environments.
- Proven ability to implement HA, DR, and security controls including encryption, authentication, and authorization.
- Solid experience supporting cloud infrastructure (AWS and Azure), with provisioning, monitoring, and troubleshooting.
- Experience collaborating cross-functionally with application teams and vendors to deliver scalable, secure, and resilient solutions.
Education: Any Graduation