Software Engineer, AI Quality & Evaluation
-
Software Development
Job Description & How to Apply Below
About Bask Health
Bask Health is a software platform that enables entrepreneurs, doctors, and healthcare businesses to launch, manage, and grow direct-to-consumer telehealth businesses.
Our platform brings together patient experiences, clinical workflows, pharmacy operations, and commerce tools in one place.
We're an entrepreneurial, product-focused engineering team that values ownership, technical excellence, and building software that solves real problems. Engineers work closely with product teams and company leadership, take features from idea to production, and have a direct role in shaping the platform.
Engineering at Bask is AI-first and builder-led. We use tools like Cursor and Claude Code throughout development while maintaining high standards for reliability, testing, and software quality.
About the RoleWe're looking for a Software Engineer, AI Quality & Evaluation to build the engineering systems that help Bask Health test, evaluate, and improve AI-powered applications throughout their development and production life cycles.
Bask Health supports direct-to-consumer telehealth businesses through a platform that connects patient experiences, merchant operations, clinical workflows, pharmacy coordination, and commerce tools. As we introduce more AI-powered capabilities across these areas, we need reliable software infrastructure that makes it easy for engineering teams to understand how those systems behave.
You'll help develop the internal tools, backend services, testing frameworks, and automation that support AI quality assurance across the platform.
This is a hands‑on software engineering role focused on building reusable systems rather than evaluating individual models in isolation. You'll work with APIs, databases, automated testing infrastructure, model integrations, and developer tools to make AI evaluation more efficient, consistent, and accessible.
Your work may include evaluation execution services, test dataset management tools, automated regression pipelines, result comparison systems, and interfaces that help engineers investigate AI failures.
You'll collaborate with applied AI engineers, machine learning engineers, AI evaluation specialists, and backend engineers to understand their testing needs and translate those requirements into dependable software capabilities.
You'll also help integrate AI evaluation into normal engineering workflows. This includes making it easier to run tests during development, compare model or prompt changes, inspect failures, and identify regressions before production releases.
Because Bask operates in healthcare‑related environments, you'll help ensure evaluation systems handle sensitive information appropriately, respect access permissions, and support testing for privacy, safety, and approved operational boundaries.
This position emphasizes strong software engineering fundamentals, developer experience, and production reliability. You'll contribute to technical architecture, write maintainable code, improve infrastructure performance, and own services that other engineering teams rely on.
We're looking for an engineer who enjoys building tools for other developers, understands the challenges of testing nondeterministic AI systems, and wants to create reliable infrastructure that improves software quality across the organization.
What You'll Do- Design, build, and maintain software infrastructure that supports AI quality and evaluation across Bask Health.
- Develop backend services that execute and manage automated AI evaluations.
- Build reusable testing tools for large language model applications.
- Create APIs that allow engineering teams to submit evaluation jobs and retrieve results.
- Develop systems for managing evaluation datasets, test cases, and…
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction