DevOps Engineer – LLMOps (AI)

About the role

Insight is looking for a DevOps Engineer with a focus on LLMOps to support its AI Development team. You will design, build, and maintain the pipelines and tooling that enable rapid, reliable delivery of AI‑powered applications.

Key responsibilities

• Design, implement and maintain CI/CD pipelines for application and AI model deployment using Azure DevOps or GitHub Actions.
• Develop LLMOps practices such as prompt versioning, model endpoint management, A/B testing of model configurations, and automated evaluation pipelines.
• Containerize applications with Docker and orchestrate deployments on Azure Kubernetes Service (AKS) or Azure App Services.
• Automate infrastructure provisioning and configuration management in collaboration with Platform Engineers.
• Implement monitoring, logging, and alerting for both services and AI model endpoints (latency, token usage, error rates, output quality).
• Manage secrets, credentials, and access controls across environments.
• Support development teams with build/release troubleshooting and maintain runbooks and operational documentation.

Required profile

• Minimum 3 years of experience in a DevOps, SRE, or release engineering role.
• Strong hands‑on experience building pipelines with Azure DevOps or GitHub Actions.
• Proficiency with Docker and experience with Kubernetes (preferably AKS).
• Experience working in Azure cloud environments.

Required skills

• Azure DevOps
• GitHub Actions
• Docker
• Kubernetes (AKS)
• Azure Kubernetes Service
• Azure App Services
• CI/CD pipeline development
• Monitoring, logging and alerting
• Secrets and credential management

What we offer

• Hybrid work model with flexibility to work from home and office.
• Opportunities for continuous upskilling, promotions and career growth.
• Being part of a Fortune 500 solutions integrator with global impact.