AI – Sr. Application Engineer -Bay area- CA

Job Title: AI – Sr. Application Engineer

Location:
Bay area, CA

Duration: FTE

• Prefer Total IT 10+ Years
• Prefer 4–7 years of software engineering with at least 2 years focused on LLM application development in production — not research, not demos, not internal tools with 10 users
• Has shipped an LLM-powered feature or product to production where real users depend on the accuracy and the engineer owns the quality metrics
• Has owned an AI safety or guardrails implementation for a customer-facing product — not just added an off-the-shelf filter; designed and tested the safety layer
• Has built RAG evaluation pipelines and used them to make go/no-go release decisions — accuracy gating is part of the workflow.
• Has profiled and optimized a multi-step LLM call chain for latency

• LLM prompt engineering — system prompts, few-shot examples, chain-of-thought, instruction following Expert Must-have
• Multi-step LLM chain orchestration — Lang Chain, Llama Index, or custom orchestration Expert Must-have
• Multi-turn conversation design — context window management, conversation summarization, session memory Advanced Must-have
• Model selection and benchmarking — matching model size to task; balancing latency, cost, and accuracy Advanced Must-have