Business Data Analyst - AI

Responsibilities

Key responsibilities include:

• Analyze chatbot analytics, conversation logs, usage patterns, and behavioral trends to identify issues related to response quality, escalation, hallucination risk, or content drift
• Investigate AI agent behavior and translate findings into recommendations, backlog items, and user stories
• Support UAT and release validation for prompt updates, indexed content changes, ingestion rule updates, and response logic enhancements
• Partner closely with AI engineers, product teams, and stakeholders to refine prompts, instructions, and agent behavior
• Build/report on analytics and dashboards (Power BI or similar) to communicate insights, trends, risks, and improvement opportunities
• Help define and monitor success metrics such as response accuracy, deflection, satisfaction, trust signals, and coverage
• Support cross‑functional communication between product, engineering, brand, and platform teams

• Strong experience in Business Analysis, Product Analytics, Product Operations, or AI/Chatbot‑focused roles
• Experience working with conversational AI, chatbots, AI agents, Copilot/GenAI tools, or prompt‑based systems
• Strong analytical mindset with experience using SQL, Power BI/Tableau, dashboards, or manual data analysis to surface insights
• Experience with Agile tools/processes including Azure Dev Ops, Jira, user stories, backlog management, and UAT

• Strong experience as a Business/Data Analyst, Product Owner, or Product Manager in digital or platform‑based products
• Comfort operating in ambiguous environments and wearing multiple hats across analysis, validation, and execution
• Experience working with analytics, dashboards, and usage data to inform product decisions (ideally with PBI and/or Adobe Analytics)
• Ability to define success metrics and evaluate product performance over time

• Experience working with chatbots, conversational interfaces, or AI assisted products (LLM experience a strong plus)
• Understanding of prompt‑based systems, guardrails, and content governance concepts
• Familiarity with retrieval‑based systems and indexed content is preferred

• Strong stakeholder management and communication skills
• Ability to translate data and technical behavior into clear business and brand implications
• Comfortable partnering closely with engineers, designers, and brand teams
• Strong ownership mindset with attention to detail and brand risk
• Analytical and curious – driven to understand why the agent behaves the way it does
• Pragmatic and execution‑oriented, balancing insight with action
• Comfortable operating in a live, evolving production environment

• Power BI, Adobe Analytics or similar analytics and reporting tools
• Experienced with querying, using SQL, Kusto, etc.

The pay range is the lowest to highest compensation we reasonably in good faith believe we would pay at posting for this role. We may ultimately pay more or less than this range. Employee pay is based on factors such as relevant education, qualifications, certifications, experience, skills, seniority, location, performance, union contract and business needs. This range may be modified in the future.

We offer comprehensive benefits including medical/dental/vision insurance, HSA, FSA, 401(k), and life, disability & ADD insurance to eligible employees. Salaried personnel receive paid time off. Hourly employees are not eligible for paid time off unless required by law. Hourly employees on a Service Contract Act project are eligible for paid sick leave.

Note:

Pay is not considered compensation until it is earned, vested and determinable. The amount and availability of any compensation remains in Kforce's sole discretion unless and until paid and may be modified in its discretion consistent with the law.

This job is not eligible for bonuses, incentives or commissions.

Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.