×
Register Here to Apply for Jobs or Post Jobs. X

AI Agents Operations Associate

Job in San Francisco, San Francisco County, California, 94199, USA
Listing for: Athelas
Full Time position
Listed on 2026-06-02
Job specializations:
  • IT/Tech
    AI Engineer (Applied/Software), Data Analyst, Technical Support, Data Scientist
Salary/Wage Range or Industry Benchmark: 60000 USD Yearly USD 60000.00 YEAR
Job Description & How to Apply Below

Requirements

  • Highly detail-oriented with strong pattern recognition
  • Comfortable working in ambiguous, fast-changing environments
  • Strong communication skills (written + verbal)
  • Ability to break down real-world workflows and edge cases
  • Excited about AI and its real-world applications
  • Willingness to be onsite and occasionally embedded with customers
  • Scrappy, proactive, and willing to take ownership
  • Experience in operations, QA, support, or healthcare environments
  • (Desirable) Exposure to call center workflows or customer support systems
  • (Desirable) Familiarity with structured testing or QA processes
What the job involves
  • We’s looking for an AI Agents Operations Associate to join our team on the front lines of deploying and improving our voice agents
  • Test and QA live AI agents
  • Work directly with real patient call flows
  • Embed within customer operations when needed
  • Help ensure our agents perform reliably in high-stakes healthcare environments
  • You won’t just be observing — you’ll be actively shaping how AI systems behave in production
  • This role is designed as a launchpad into an Implementation Manager role within ~6 months, for candidates who demonstrate strong ownership and execution
  • Test end-to-end call flows (scheduling, rescheduling, cancellations, intake, etc.)
  • Identify bugs, edge cases, and breakdowns in agent behavior
  • Log, categorize, and prioritize issues across severity levels (critical / major / minor)
  • Validate that agent actions are correctly reflected in downstream systems (e.g., EHR)
  • Embed with customer front desk / call center teams when needed
  • Operate as a live scheduler to deeply understand workflows
  • Act as a bridge between customer operations and engineering
  • Surface real-world insights to improve agent performance
  • Support QA processes across internal and offshore teams
  • Review call transcripts, recordings, and agent decisions at scale
  • Help define and refine QA frameworks, rubrics, and best practices
  • Ensure consistency and quality across all testing workflows
  • Partner closely with engineering, product, and operations teams
  • Provide structured feedback to improve agent logic and performance
  • Help iterate quickly on deployments in fast-moving environments
  • Work on real AI systems in production — not demos or prototypes
  • Direct exposure to customers and live environments
  • High ownership early in your career
  • Clear path to Implementation Manager in ~6 months
  • Be part of scaling AI across large healthcare systems
  • This is not a traditional entry-level role
  • You’ll be working at the intersection of:
  • AI systems
  • Healthcare operations
  • Real-world deployment
  • If you’re excited about building, testing, and scaling AI in production environments, this role will give you unmatched exposure and growth
#J-18808-Ljbffr
Position Requirements
10+ Years work experience
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
 
 
 
Search for further Jobs Here:
(Try combinations for better Results! Or enter less keywords for broader Results)
Location
Increase/decrease your Search Radius (miles)
0
200
Filters
Education Level
Experience Level (years)
Posted in last:
Salary