GenAI​/LLM Platform Engineer

About The Role

The role is for someone who has moved beyond prompting and understands what it takes to build production-grade AI systems: RAG pipelines, agentic workflows, fine-tuning pipelines, and systematic evaluation frameworks.

You will own complex pieces of an AI platform and work directly with applied scientists, backend engineers, and enterprise clients to ship features that are genuinely relied on in production.

• Design and implement RAG pipelines using Lang Chain, Llama Index, or custom architectures - including chunking strategies, embedding selection, and retrieval quality optimization
• Build and optimize vector database integrations (Pinecone, Weaviate, Chroma, pgvector) for semantic search at production scale
• Develop systematic LLM evaluation frameworks: benchmark suites, LLM-as-judge pipelines, regression testing, and hallucination detection
• Run instruction fine-tuning and parameter-efficient fine-tuning (LoRA, QLoRA) on domain-specific datasets
• Collaborate with backend engineers to integrate LLM capabilities into production APIs with appropriate latency, cost, and reliability constraints
• Track and synthesize relevant LLM research and translate high-value advances into product features
• Write observable, tested, and well-documented code; participate in architecture reviews and production incident response

• 2–5 years of software engineering experience, including at least 1 year working with LLMs in a production or near-production context
• Deep familiarity with at least one LLM orchestration framework:
  Lang Chain, Llama Index, or equivalent
• Hands‑on experience with OpenAI, Anthropic, Google Gemini, or open‑source model APIs at meaningful scale
• Understanding of embedding models, vector databases, and semantic similarity in production environments
• Strong Python skills; comfort with async programming, REST API design, and cloud infrastructure (AWS/GCP/Azure)
• MS or BS in Computer Science, AI, or related field; equivalent demonstrable experience welcomed
• Bonus: fine‑tuning experience (LoRA/QLoRA), RLHF pipeline exposure, multi‑agent system design, or contributions to open-source AI tooling

New York City (Hybrid)

San Francisco Bay Area

Austin, TX

Remote strongly considered