Senior Infrastructure Engineer, AI Platform , NY

Location

New York, NY

Level

Senior

Reports To

Leadership

Salary Range

$250k - $350k

Manifest OS is an AI-native company on a mission to replace the billable hour and make legal services more accessible for American businesses and consumers. We power the next generation of AI-native law firms with one unified global brand, a proprietary technology platform, and a centralized back office — enabling lawyers to eliminate the administrative burden and focus on delivering exceptional outcomes for their clients.

Backed by leading venture investors, Manifest O.S. is scaling rapidly.

Our AI Platform team builds the foundational systems powering AI features across our entire product. We're the engine room that makes it possible for product engineers to ship LLM-powered features without drowning in the operational complexity of model management, cost optimization, and reliability concerns. The team collaborates closely with product engineering, data science, and platform teams to ensure our AI infrastructure scales seamlessly with business needs.

You have 6-9 years of infrastructure engineering experience with a proven track record of building and operating distributed systems at production scale. You've lived through the challenges of high-throughput, low-latency systems and understand the tradeoffs between consistency, availability, and partition tolerance. Your background likely includes experience with service meshes, API gateways, observability platforms, or developer tooling — areas where reliability and developer experience are equally critical.

While you may not have extensive AI/ML experience, you're comfortable diving into unfamiliar technical domains and have the systems thinking to tackle the unique challenges of LLM operations. You understand that AI infrastructure is fundamentally different from traditional backend systems — dealing with non-deterministic outputs, variable latencies, cost optimization across multiple vendors, and the rapid pace of model evolution. You've likely worked on platform teams before and understand that your success is measured by enabling other engineers to ship faster and more reliably.

You're the type of engineer who thinks in abstractions and APIs. When faced with complex operational challenges, your instinct is to build systems that solve the problem once for everyone rather than letting each team solve it individually. You have strong opinions about developer experience and can balance the competing demands of flexibility, simplicity, and performance when designing platform services.

This role sits at the intersection of traditional infrastructure engineering and the emerging world of LLM operations. You'll be building the critical platform that abstracts away the complexity of AI/ML systems for our product engineers, making it trivial for them to integrate sophisticated AI capabilities into user-facing features. Think of yourself as the architect of our AI nervous system — designing the model gateway that routes requests intelligently, building observability systems that give us visibility into black-box model behavior, and creating developer tools that make prompt engineering feel like traditional software development.

The impact of this role extends far beyond infrastructure. Every AI feature our company ships will rely on the systems you build. You'll be solving fascinating technical challenges: how do you route requests between different model providers to optimize for cost and latency? How do you build reliable observability for non-deterministic systems? How do you create developer experiences that make working with LLMs feel predictable and…