More jobs:
Job Description & How to Apply Below
At Delphi, we believe in creating an environment where our people thrive. Our hybrid work model empowers you to choose where you work—whether it's from the office, your home, or a mix of both so you can prioritize what matters most. We are committed to supporting your personal goals, family, and overall well being while driving transformative results for our clients.
We welcome exceptional talent from anywhere across the globe. Interviews and onboarding are conducted virtually, reflecting our digital-first mindset.
Rooted in the region, we specialize in delivering tailored, impactful solutions in Data, Advanced Analytics and AI, Infrastructure, Cloud Security, and Application Modernization. Whether it’s enabling predictive analytics, transforming operations with automation, or driving customer engagement with intelligent platforms, we are the trusted partner for organizations ready to embrace a smarter, more efficient future.
About the Role:
LLMOPS
Location:
India Remote
Experience - 8+ years
Full time
The Azure LLMOps Engineer is responsible for operationalizing, securing, and governing Large Language Model (LLM)–based solutions on Microsoft Azure. The role ensures that LLM applications move reliably from development to production with strong controls around quality, security, cost, and compliance. This role sits at the intersection of Dev Ops, MLOps, and AI platform engineering, focusing on the lifecycle management of prompts, agents, models, and runtimes rather than model training.
The LLMOps Engineer establishes CI/CD pipelines, evaluation frameworks, and runtime guardrails that enable development teams to safely consume Azure OpenAI and related AI services at enterprise scale. The role is critical in regulated and enterprise environments, where requirements such as signed artifacts, auditability, environment isolation, private networking, and controlled promotion are mandatory. By standardizing deployment, monitoring, and governance practices, the Azure LLMOps Engineer enables teams to innovate with LLMs while maintaining operational stability, security, and regulatory compliance.
What you will do
1. Design, build, and operate enterprise-grade LLM platforms on Microsoft Azure
2. Deploy and manage LLM runtimes using Azure OpenAI, AKS, App Service, or Azure ML
3. Implement and maintain CI/CD pipelines for LLM applications, prompts, and agents
4. Enforce digest-based artifact promotion across environments (DEV / NON-PROD / PROD)
5. Manage the lifecycle of prompts, agents, and configurations, including versioning and rollback
6. Implement LLM evaluation and quality gates (relevance, groundedness, hallucination checks)
7. Integrate RAG architectures using Azure AI Search and secure data sources
8. Implement supply-chain security controls including SBOM generation and image signing
9. Enforce runtime policy controls (signed images only, admission checks, environment isolation)
10. Secure LLM workloads using Managed Identity, Key Vault, and Private Endpoints
11. Enable observability and monitoring for prompts, responses, latency, errors, and token usage
12. Implement cost tracking and optimization for LLM consumption and inference workloads
13. Define and enforce guardrails for prompt injection, data leakage, and misuse scenarios
14. Support audit, compliance, and evidence collection for regulated environments
15. Collaborate with application, security, and cloud infrastructure teams on platform standards
16. Create and maintain runbooks, standards, and reference architectures for LLMOps
17. Support onboarding and enablement of development teams onto the LLM platform
18. Contribute to documentation, testing, and UAT processes to validate data solutions.
Skills Required
1. Azure & Cloud Platform (Must-Have)
Hands-on experience with Azure OpenAI and enterprise LLM deployments
Strong knowledge of Azure Kubernetes Service (AKS), App Service, or Azure ML for LLM
runtimes
Experience with Azure Dev Ops or Git Hub Actions for CI/CD
Solid understanding of Azure networking and security, including:
Private Endpoints
VNet-integrated services
Network isolation across environments
Proficiency…
Note that applications are not being accepted from your jurisdiction for this job currently via this jobsite. Candidate preferences are the decision of the Employer or Recruiting Agent, and are controlled by them alone.
To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search:
To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search:
Search for further Jobs Here:
×