DevOps Engineer (LLMOps focus)

About the role

Insight is seeking a DevOps Engineer with a focus on LLMOps to support its AI Development team. The role involves building and maintaining CI/CD pipelines, automation, and operational tooling to deliver AI‑powered applications quickly and reliably. You will work in a hybrid setting, collaborating with platform and development engineers.

Key responsibilities

• Design, build, and maintain CI/CD pipelines for application and AI model deployment using Azure DevOps or GitHub Actions.
• Implement LLMOps practices such as prompt versioning, model endpoint management, A/B testing of model configurations, and automated evaluation pipelines.
• Containerize applications with Docker and manage deployments to Azure Kubernetes Service (AKS) or Azure App Services.
• Automate infrastructure provisioning, configuration management, and environment setup in partnership with Platform Engineers.
• Implement monitoring, logging, and alerting for both application services and AI model endpoints (latency, token usage, error rates, output quality).
• Manage secrets, credentials, and access controls across deployment environments.
• Support development teams with build/release troubleshooting, environment issues, and deployment best practices.
• Maintain runbooks and operational documentation for incident response and release procedures.

Required profile

• Minimum 3 years of experience in a DevOps, SRE, or release engineering role.
• Strong hands‑on experience building and managing pipelines with Azure DevOps or GitHub Actions.
• Proficiency with Docker and Kubernetes (AKS) or similar container orchestration platforms.
• Experience working with Azure cloud services.
• Familiarity with AI/ML model deployment concepts is a plus.
• Ability to work effectively in a hybrid environment.

Required skills

• Azure DevOps
• GitHub Actions
• Docker
• Kubernetes
• Azure Kubernetes Service (AKS)
• Azure App Services
• CI/CD pipelines
• LLMOps (prompt versioning, model endpoint management, A/B testing)
• Monitoring and logging tools
• Secret management

What we offer

• People‑first culture within a Fortune 500 Solutions Integrator.
• Continuous upskilling, promotion pathways, and career growth opportunities.
• Hybrid work model with collaborative teams.