Product Engineer; Hybrid

The Mission:

Our AI engineers make a real impact on the safety and ROI of large language models and agentic applications across different verticals and domains. You will work on the cutting edge of envisioning and building new types of tools and algorithms to monitor, explain, and improve such applications and in turn empower our customers.

About The Team:

Our engineering team is a dynamic group of builders and thinkers dedicated to solving some of the most cutting-edge challenges in AI safety and reliability. Working on exciting and an expansive range of topics, from the responsible deployment of machine learning models, large language models (LLMs), to complex agentic applications. Our projects are inherently cross-disciplinary, requiring expertise in systems engineering, product engineering, and data science to build robust, scalable solutions.

We thrive in a collaborative environment where continuous learning is at the forefront, ensuring every team member stays on their toes with the latest advancements in AI. Joining our team means you'll have the opportunity to make a tangible impact on how AI evolves for the benefit of humanity.

What You'll Do:

• Design and build core services and components of a world-class cloud platform to help enterprises develop, monitor and improve their full suite of AI based applications (covering predictive models, LLMs, GenAI models and agentic applications)

• Lead the design and implementation of distributed systems, microservices and applications that compute, persist, and expose new ML + agentic observability metrics (e.g., response relevancy, hallucination scores) from raw trace data

• Spearhead the development of new types of metrics and evaluation capabilities to satisfy evolving customer needs around agentic applications. Take part in conversations with customers around discovery and support

• Developer in-house AI Agents and GenAI capabilities to augment the Fiddler observability products

• Define and evolve the operational maturity (reliability, observability, SLOs, observability) of core services and components, establish best practices and champion improvements across the team

• Team & Culture Building: you will take an active role in building a world-class engineering team and actively participate in the talent acquisition process through interviewing, candidate evaluation and coaching

What You Must Have:

• Masters or Bachelors degree in Computer Science or related field, combined with 7+ years of industry experience, with demonstrated solid foundation in software development

• Deep proficiency with Python

• Prior experience building and operating highly complex SaaS platforms and systems

• Work closely with product, design, and customer engineering teams to improve and expand our product offerings

Nice to Haves

• Practical working knowledge of machine learning and data science

• Experience with OLAP systems, Postgres, Redis, Kafka, RabbitMQ, Ray and Spark

• Familiarity with frameworks like Langchain, Lang Graph, Google ADK, Amazon Strands, OpenAI, etc.

• Experience building and integrating MCP Servers

• Hands-on experience designing, implementing, or operating AI/ML observability or evaluation systems

• Coaching & Mentorship:
  Serve as a strong collaborator and a mentor to other team members, raising the technical bar for the entire team and regularly engage in code and design reviews

• Ability to work in our Palo Alto office 3 days a week

Compensation:

Bay Area, New York City & Seattle range $190,000 - $300,000 + equity + benefits

Other Locations: $175,000 - $215,000 + equity + benefits

• Unlimited PTO

• Competitive pay + equity

• Premium health, dental & vision – for you, 100% premiums covered with buy-up options.

• 401(k) plan

• Monthly fitness reimbursement

• Paid parental leave

• Palo Alto HQ Vibes

• Free annual Caltrain pass

• Monthly in-office massages

• Fastrak reimbursement

• Free lunch Mon–Thurs

The posted range represents the expected salary range for this job requisition and does not include any other potential components of the compensation package and perks previously outlined. Ultimately, in determining pay, we'll consider your experience, leveling, location, and other job-related factors.

Fiddler is proud to be an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. If you require special accommodations in order to complete the interviews or perform job duties, please inform the recruiter at the beginning of the process.

Beware of job scam fraud. Our recruiters use  email addresses exclusively. In the US, we do not conduct interviews via text or instant message, or ask for sensitive personal information such as bank account or social security numbers.