AI Business Data Consultant
Job in
Torrance, Los Angeles County, California, 90504, USA
Listed on 2026-06-10
Listing for:
TEKsystems c/o Allegis Group
Full Time
position Listed on 2026-06-10
Job specializations:
-
IT/Tech
Data Analyst, AI Engineer (Applied/Software), Data Scientist, Data Science Manager
Job Description & How to Apply Below
This role will help ensure AI-powered customer experiences are accurate, reliable, measurable, and continuously improving. The analyst will monitor production LLM application performance, evaluate response quality, build dashboards, identify risks and opportunities, and synthesize insights that inform product roadmap decisions, feature requirements, backlog prioritization, and operational improvements.
Supports our AI products by analyzing performance, defining KPIs, and driving continuous improvement for generative and conversational AI applications. Monitors LLM outputs, evaluates response quality, and builds dashboards/scorecards to track product health, user behavior, and business impact. Identifies risks (hallucinations, drift, retrieval issues) and translates insights into actionable product recommendations, backlog priorities, and experiments.
The ideal candidate combines strong analytical skills, product sense, technical curiosity, and practical understanding of generative AI applications, including conversational AI, RAG, prompt-based systems, AI evaluation metrics, and LLM-as-a-judge methodologies.
- Define and track KPIs for AI product performance, CX outcomes, and business impact
- Analyze conversation logs, user behavior, and performance data to identify trends and issues
- Evaluate AI output quality using rubrics, test sets, and LLM evaluation methods
- Build dashboards, scorecards, and reporting to monitor product health
- Identify risks (hallucination, drift, retrieval errors) and recommend improvements
- Support product discovery, experimentation, and A/B testing
- Translate insights into product requirements, backlog items, and acceptance criteria
- Partner with product, engineering, and CX teams on releases, UAT, and optimization
- 3+ years in data analytics, product analytics, or business analysis roles
- Experience supporting digital or AI-driven products (chatbots, conversational AI, etc.)
- Strong SQL and dashboarding/visualization skills (Power BI, Tableau, etc.)
- Experience defining KPIs and analyzing user behavior and product performance data
- Working knowledge of generative AI, LLMs, prompting, and RAG concepts
- Strong analytical, communication, and cross-functional collaboration skills
This is a Contract position based out of Torrance, CA.
Pay and Benefits
The pay range for this position is $50.00 - $54.00/hr.
Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to specific elections, plan, or program terms. If eligible, the benefits available for this temporary role may include the following:
Medical, dental & vision
Critical Illness, Accident, and Hospital
401(k) Retirement Plan - Pre-tax and Roth post-tax contributions available
Life Insurance (Voluntary Life & AD&D for the employee and dependents)
Short and long-term disability
Health Spending Account (HSA)
Transportation benefits
Employee Assistance Program
Time Off/Leave (PTO, Vacation or Sick Leave)
Workplace Type
This is a hybrid position in Torrance,CA.
Final date to receive applications
This position is anticipated to close on Jun 23, 2026.
About TEKsystems
We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change.
That's the power of true partnership. TEKsystems is an Allegis Group company.
The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.
About TEKsystems and TEKsystems Global Services
We're a leading provider of business and technology services. We accelerate business transformation for our customers. Our expertise…
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×