ELK Stack Engineer

• Maintaining, supporting and setting up new Elasticsearch cluster following best practices.­
• Decommissioning and Recommissioning servers.
• Knowledge of complete ELK Stack from infrastructure standpoint.
• Able to evaluate existing Elastic clusters, configuration parameters, indexing, security and administration.
• Understanding of Networking to support the network related pipelines.
• Team player.

Qualifications:

• Overall 9-10+ years of experience in IT.
• 7+ years of experience with ELK Stack: Elastic Search, Logstash, Kibana.
• Good to have Ruby and/or Python, GIT and Unix Shell scripting knowledge.

Responsibilities Include:

• Administer and optimize the Elastic Stack (Elasticsearch, Logstash, Kibana, Beats), focusing on logging use cases.
• Implement and manage Index Lifecycle Management (ILM) policies, snapshots, and searchable snapshots for efficient data storage
• Design and implement Hot-Warm- Cold architecture for scalable and cost-effective data management.
• Configure index templates to ensure consistency and best practices across all indices.
• Architect and size Elasticsearch clusters based on business requirements and performance needs.
• Automate deployment and configuration management using Ansible.
• Write shell scripts to automate routine task and optimize operations.
• Utilize GIT for version control and collaborative configuration management.
• Plan and execute Elastic Stack version upgrades and patching with minimal downtime.
• Configure Grafana dashboards for monitoring and visualization of Elasticsearch data.
• Set up and manage alerting systems to monitor cluster health and performance.
• Integrate Logstash, Kafka and Beats for data ingestion and log forwarding.
• Troubleshoot, diagnose, and resolve issues related to Elasticsearch, Logstash, Kibana and related components.
• Collaborate with cross functional teams to gather requirements and design elastic stack solution tailored to specific use cases