Software Engineering SMTS
Listed on 2026-07-08
-
Software Development
AI QA / Validation Engineer, Software Testing, AI Engineer (Applied/Software)
Job Title
Senior Member of Technical Staff (SMTS)
Job CategorySoftware Engineering
About SalesforceSalesforce is the #1 AI CRM, where humans with agents drive customer success together. Ambition meets action, tech meets trust, and innovation is a way of life. We seek Trailblazers who are passionate about bettering business and the world through AI, driving innovation, and keeping Salesforce's core values at heart.
Job DetailsWe are infusing AI into every aspect of our software engineering. While AI writes code, validation ensures enterprise‑quality. We need an enthusiastic Senior engineer focused on AI‑first testing and validation to keep code production‑ready for our customers. The role is within Product Led Growth (PLG) in the Self‑Service and Growth organization, helping new customers self‑service and get started with Salesforce through a prescriptive out‑of‑the‑box experience that shortens time to value across Marketing, Sales, Service, and Commerce.
Initiatives include Onboarding Workflows, Agentic Getting Started, and Slack UI. Prior experience with agentic products is a plus.
- Design, build, and maintain scalable, AI‑first testing frameworks and automation suites for complex PLG workflows and agentic capabilities.
- Translate high‑level quality strategies into actionable automation plans, focusing on validating LLM integrations, prompt accuracy, and deterministic system behaviors.
- Conduct deep code reviews to understand system architecture, identify quality gaps, perform white‑box testing, and actively contribute to fixing code and test flakiness.
- Implement and support evaluation processes for subjective quality dimensions of AI features, such as response relevance, user safety, and contextual accuracy.
- Collaborate closely with developers, product managers, and engineers across the PLG ecosystem to integrate quality early and continuously throughout the agile delivery lifecycle.
Skills and Qualifications
- Strong technical fundamentals in Java, including data structures and algorithms.
- Hands‑on experience evaluating Large Language Models (LLMs) for quality response; familiarity with GPT‑like models and AI evaluation frameworks is a big plus.
- Proven track record of delivering automation solutions in a fast‑paced CI/CD environment while maintaining quality.
- Excellent communication and collaboration skills for working cross‑functionally with product managers, engineers, AI/ML engineers, and data scientists.
- Strong analytical and problem‑solving abilities with a focus on identifying quality gaps and driving improvement.
- Software engineer with a strong coding background and experience delivering software at pace in an agentic PDLC.
- Strong experience with white‑box testing and fixing code.
- Experience working with public cloud infrastructure (AWS, Azure, GCP) and/or foundational knowledge of the Salesforce platform;
Salesforce certifications are a plus. - Prior experience testing autonomous agents, conversational UIs, or generative AI workflows.
Compensation will be determined by location, job level, knowledge, skills, and experience. Certain roles may be eligible for incentive compensation, equity, and benefits. Benefits include time‑off programs, medical, dental, vision, mental health support, paid parental leave, life and disability insurance, a 401(k) plan, and an employee stock purchasing program. Base salary for this position ranges from $148,500 to $223,900 annually, or $178,900 to $246,000 annually in select San Francisco and New York City metropolitan areas.
The range represents base salary only and does not include bonus, equity, or other benefits. Salesforce also considers applicants with arrest and conviction records under the San Francisco Fair Chance Ordinance and the Los Angeles Fair Chance Initiative for Hiring.
If you need a reasonable accommodation during the application or recruiting process, please submit a request via the Accommodations Request Form.
EEO StatementSalesforce is an equal‑opportunity employer and maintains a policy of non‑discrimination with all employees and applicants for employment. We believe in equality for all and lead to equality by creating an inclusive workplace free from discrimination. All employees and applicants are assessed on the basis of merit, competence, and qualifications without regard to race, religion, color, national origin, sex, sexual orientation, gender expression or identity, transgender status, age, disability, veteran or marital status, political viewpoint, or other classifications protected by law.
This policy applies to recruiting, hiring, job assignment, compensation, promotion, benefits, training, performance assessment, discipline, termination, and all related areas. Recruiting, hiring, and promotion decisions are fair and based on merit.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).