Artificial Intelligence Operations Engineer; Hybrid, Morrisville, NC
Morrisville, Wake County, North Carolina, 27560, USA
Listed on 2026-10-18
-
IT/Tech
AI Engineer (Applied/Software), Cloud Computing: Infrastructure & Operations, SRE/Site Reliability, Cybersecurity
TheAI Operations Engineer is responsible for the operational stability, reliability, and continuous performance of deployed AI models and services. The AI Operations Engineer ensures that AI solutions built are seamlessly operationalized, monitored, and maintained in production environments. By managing the lifecycle of AI applications, from automated deployment and infrastructure scaling to real-time monitoring and incident response, this role ensures that AI-driven capabilities remain secure, cost-efficient, and highly available to support Alliance Health’s mission-critical clinical and operational workflows.
This position is full-time hybrid. Selected candidate must come into the Home office in Morrisville on Wednesdays, for business meeting as needed, reside within 50 miles of Morrisville North Carolina.
Responsibilities & Duties AI Model Deployment & Infrastructure Operations- Deploy, monitor, support, and maintain AI models in production environments, ensuring seamless integration with existing enterprise systems
- Develop and manage automated CI/CD and MLOps pipelines for model packaging, testing, deployment, rollback, and full lifecycle management
- Architect and manage hybrid cloud-AI environments that support multi-model, multi-agent, and edge AI deployments
- Implement infrastructure automation using scripting, Infrastructure as Code (IaC), and configuration management to ensure scalable and resilient AI services
- Design and optimize AI infrastructure in collaboration with server, cloud, and platform engineering teams to support high-performance workloads
- Maintain comprehensive observability across all AI systems through advanced logging, metrics, performance monitoring, tracing, and alerting
- Detect and respond to critical operational risks, including model drift, performance degradation, and training-serving skew
- Define and monitor key operational metrics such as availability, latency, throughput, token consumption, model cost, and task-completion rates
- Provide ongoing technical support, including rapid incident response, troubleshooting, and root cause analysis for AI platforms and user-facing services
- Improve platform reliability, resilience, and cost-efficiency through continuous tuning, automation, and operational improvements
- Partner with Cybersecurity, Risk, and AI Governance teams to implement and evidence required security controls
- Implement threat-resistant AI infrastructure and enforce security frameworks to protect against data exfiltration and unauthorized access
- Ensure compliance with regulatory obligations and internal policies by maintaining model version control, audit trails, and lineage/traceability for data, prompts, and outputs
- Enforce data governance patterns, including privacy controls, data masking, and the secure management of secrets and identity across AI workflows
- Enable self-service platform consumption for AI Engineers and Data Scientists via standardized APIs, reusable pipelines, templates, and documentation
- Collaborate across divisions to align technical implementations with mission-critical business objectives and reduce operational disruption
- Communicate technical constraints such as latency, cost, and performance effectively to business stakeholders and technical leads
- Evaluate emerging AI tools, frameworks, and infrastructure approaches to determine their operational fit, supportability, and long-term value for the organization
- Develop and maintain essential technical documentation, including runbooks, architecture diagrams, and standard operational procedures
- Provide hands-on technical assistance to resolve issues arising from the integration of AI models into existing business workflows and systems
- Perform root cause analysis for technical failures in AI pipelines, including issues related to data integration, model performance, or infrastructure connectivity
- Support users in navigating technical complexities related to new AI platforms, tools, and orchestration frameworks to ensure minimal disruption to their operations
Bachelor’s degree in Computer Science, Data Science, Artificial Intelligence, or a related field from an accredited college or university, and three (3) years of experience developing, implementing, and deploying software, machine learning, and/or artificial intelligence solutions.…
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).