Information Designer II
-
IT/Tech
Job Description & How to Apply Below
Primary
Skills:
Conversation Design (advanced), AI Evaluations & Golden Datasets (advanced), Prompt Engineering (advanced), Data Analysis (advanced), AI Agentic Platforms (intermediate)
Contract Type: W2 Only
Location:
Mountain View, CA (#Hybrid)
Duration: 12 months
Pay Range: $45-$50 Per Hour on W2
JOB SUMMARYThis role focuses on improving the quality and accuracy of AI-powered chatbots and voice assistants. You will design conversational experiences, build golden datasets, evaluate AI-generated responses at scale, and provide insights to improve AI performance.
JOB REQUIREMENTS- Design conversation strategies, principles, and playbooks for AI-powered products.
- Build AI skills using Claude Code or similar tools to generate golden datasets.
- Evaluate AI responses using LLM-as-a-Judge models and human feedback.
- Analyze AI answer quality, accuracy, and customer experience trends.
- Partner with Engineering and Data Science teams to drive improvements.
- Must have 8+ years of design experience, including 4+ years in Conversation Design.
- Must have 1+ year of experience with AI agentic platforms.
- Strong expertise in prompt engineering, AI tools, and data analysis.
- Understanding of LLMs, NLP/NLU, RAG, or machine learning frameworks.
- Working knowledge of Python, HTML, XML, Regex, or similar coding languages.
Experience in conversational AI, chatbots, voice assistants, AI evaluation, or generative AI products is preferred.
ABOUT AKRAYAAkraya is an award-winning IT staffing firm consistently recognized for our commitment to excellence and a thriving work environment. Most recently, we were recognized Inc's Best Workplaces 2024 and Silicon Valley's Best Places to Work by the San Francisco Business Journal (2024) and Glassdoor's Best Places to Work (2023 & 2022)!
Industry Leaders in IT Staffing As staffing solutions providers for Fortune 100 companies, Akraya's industry recognitions solidify our leadership position in the IT staffing space.
We don't just connect you with great jobs, we connect you with a workplace that inspires!
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction