Kafka Administrator

We are seeking a highly skilled Kafka Administrator to support and manage mission-critical infrastructure for our client, DTCC. The ideal candidate will have extensive hands-on experience in Kafka cluster setup, management, and administration, particularly with the Confluent platform.

Key Responsibilities:

• Design, implement, and maintain Kafka clusters, including high-availability and disaster recovery configurations.
• Manage and monitor Kafka Connect, Kafka Brokers, Zookeeper, and other components within the Kafka ecosystem.
• Set up and configure Kafka Connectors for data integration with external systems.
• Administer and optimize the Confluent Kafka Platform, ensuring security, scalability, and performance.
• Perform cluster capacity planning, upgrades, patching, and performance tuning.
• Implement and manage monitoring, alerting, and logging solutions for Kafka infrastructure.
• Collaborate with development, infrastructure, and DevOps teams to support Kafka-based application integrations.
• Troubleshoot issues and perform root cause analysis in a production environment.
• Create and maintain documentation related to Kafka configurations, processes, and procedures.

Required Skills & Experience:

• 5+ years of experience in Kafka administration and support in enterprise environments.
• Strong hands-on experience with setting up and managing Kafka clusters from scratch.
• Proficiency in Kafka Connect setup and integration.
• Deep understanding of Confluent Kafka platform and its ecosystem.
• Strong experience with Linux systems, including scripting (Bash, Python, etc.).
• Knowledge of Kafka security (SSL, SASL, ACLs) and authentication/authorization mechanisms.
• Experience with monitoring tools like Prometheus, Grafana, Confluent Control Center, etc.
• Familiarity with containerized Kafka deployments (e.g., Docker, Kubernetes) is a plus.

Preferred Qualifications:

• Confluent Certified Administrator or Developer certification.
• Experience with CI/CD pipelines and infrastructure as code tools (e.g., Ansible, Terraform).
• Financial services or high-volume data streaming experience is a strong plus