AI Agents Operations Associate
Job in
San Francisco, San Francisco County, California, 94199, USA
Listed on 2026-06-02
Listing for:
Athelas
Full Time
position Listed on 2026-06-02
Job specializations:
-
IT/Tech
AI Engineer (Applied/Software), Data Analyst, Technical Support, Data Scientist
Job Description & How to Apply Below
Requirements
- Highly detail-oriented with strong pattern recognition
- Comfortable working in ambiguous, fast-changing environments
- Strong communication skills (written + verbal)
- Ability to break down real-world workflows and edge cases
- Excited about AI and its real-world applications
- Willingness to be onsite and occasionally embedded with customers
- Scrappy, proactive, and willing to take ownership
- Experience in operations, QA, support, or healthcare environments
- (Desirable) Exposure to call center workflows or customer support systems
- (Desirable) Familiarity with structured testing or QA processes
- We’s looking for an AI Agents Operations Associate to join our team on the front lines of deploying and improving our voice agents
- Test and QA live AI agents
- Work directly with real patient call flows
- Embed within customer operations when needed
- Help ensure our agents perform reliably in high-stakes healthcare environments
- You won’t just be observing — you’ll be actively shaping how AI systems behave in production
- This role is designed as a launchpad into an Implementation Manager role within ~6 months, for candidates who demonstrate strong ownership and execution
- Test end-to-end call flows (scheduling, rescheduling, cancellations, intake, etc.)
- Identify bugs, edge cases, and breakdowns in agent behavior
- Log, categorize, and prioritize issues across severity levels (critical / major / minor)
- Validate that agent actions are correctly reflected in downstream systems (e.g., EHR)
- Embed with customer front desk / call center teams when needed
- Operate as a live scheduler to deeply understand workflows
- Act as a bridge between customer operations and engineering
- Surface real-world insights to improve agent performance
- Support QA processes across internal and offshore teams
- Review call transcripts, recordings, and agent decisions at scale
- Help define and refine QA frameworks, rubrics, and best practices
- Ensure consistency and quality across all testing workflows
- Partner closely with engineering, product, and operations teams
- Provide structured feedback to improve agent logic and performance
- Help iterate quickly on deployments in fast-moving environments
- Work on real AI systems in production — not demos or prototypes
- Direct exposure to customers and live environments
- High ownership early in your career
- Clear path to Implementation Manager in ~6 months
- Be part of scaling AI across large healthcare systems
- This is not a traditional entry-level role
- You’ll be working at the intersection of:
- AI systems
- Healthcare operations
- Real-world deployment
- If you’re excited about building, testing, and scaling AI in production environments, this role will give you unmatched exposure and growth
Position Requirements
10+ Years
work experience
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×