LLMOps Engineer

Core Skills needed –

• Strong experience in developing, deploying, and managing large language models, specifically on Microsoft Azure.

• Proven expertise in Azure cloud platforms and services, including Azure Machine Learning, Azure Kubernetes Service, and Azure DevOps.

• Strong knowledge of LLMOPS guardrails implementation practices.

• Strong communication skills and the ability to convey complex technical concepts to non-technical stakeholders.

Experience with Python/

Job Duties:

• Ops support for LLM models including incidents management, ongoing model management and maintenance, and user support

• GenAI solutions monitoring and maintenance, including performance monitoring, user interaction monitoring and efficacy monitoring

• Guardrails review and monitoring including bais audits, and other identified guardrail checks based on implemented GenAI solutions

• Code management support including proactive code optimization beyond breakfixes

LLMs provide context and memory capabilities, while generative AI enables the production of engaging responses