LLM Platform Engineer

Join the Future of Commerce with Whatnot

Whatnot is the largest livestream shopping platform in North America and Europe, where sellers build thriving businesses across a wide range of categories. We are shaping a new industry by creating live commerce at a scale never before seen in the West.

We are seeking highly entrepreneurial engineers to build the core infrastructure that powers large language model (LLM) applications across the company. In partnership with machine learning scientists, you will bring cutting‑edge models into production and unlock new product experiences. You will design systems that make AI dependable and fast at scale, such as retrieval systems that ground LLM responses in Whatnot’s business context, scalable evaluation frameworks, and human‑in‑the‑loop feedback mechanisms.

• Own the infrastructure that powers LLMs across critical business surfaces, including growth, recommendations, trust and safety, fraud, seller tooling, and more.
• Create robust and scalable LLM evaluation frameworks to measure model performance, guide iteration, and prevent regression via CI/CD.
• Deploy RAG systems and MCP servers to ground LLM responses in business context while enforcing strict PII controls.
• Design efficient human‑in‑the‑loop feedback pipelines that inform scalable LLM evaluation.
• Bridge the gap between research and production, transforming experimental ideas into scalable solutions.
• Take on new technical challenges as AI scales across Whatnot’s ecosystem.

• 4+ years of professional experience developing machine learning systems and algorithms.
• Bachelor’s degree in Computer Science, Statistics, Applied Mathematics, or a related technical field, or equivalent experience.
• 3+ years of software engineering experience building and maintaining production systems for consumer‑scale loads.
• 1+ year of professional experience developing software in Python.
• Proof of autonomous work, driving initiatives across multiple product areas, and communicating findings with leadership and product teams.
• Experience with operational, search, and key‑value databases such as PostgreSQL, DynamoDB, Elasticsearch, and Redis.
• Strong grasp of visualization tools for monitoring and logging (e.g., Data Dog, Grafana).
• Familiarity with cloud computing platforms and managed services, including AWS Sage Maker, Lambda, Kinesis, S3, EC2, EKS/ECS, Apache Kafka, and Flink.
• Professionalism in a remote working environment and a commitment to well‑tested, reproducible work.
• Exceptional documentation and communication skills.

• Flexible time‑off policy and company‑wide holidays, including spring and winter breaks.
• Health insurance options, including medical, dental, and vision coverage.
• Work‑from‑home support, including a home office setup allowance and a monthly allowance for cell phone and internet.
• Care benefits, such as monthly wellness allowance, annual childcare allowance, and lifetime benefits for family planning, adoption, or fertility expenses.
• Retirement plans: 401(k) offering for traditional and Roth accounts in the US (employer match up to 4% of base salary) and pension plans internationally.
• Monthly allowance to dog‑food the app, encouraging all employees to develop a deep understanding of our product through personal use.
• Parental leave: 16 weeks of paid leave and a gradual return to work; company leave allowances run concurrently with country leave requirements.

Whatnot is proud to be an equal‑opportunity employer. We value diversity and do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, parental status, disability status, or any other status protected by local law.

Compensation Range: $245,000 - $345,000