×
Register Here to Apply for Jobs or Post Jobs. X

Senior Software Engineer, AI​/ML; Infrastructure & Platform

Job in New York, New York County, New York, 10261, USA
Listing for: Alumni Ventures
Full Time position
Listed on 2026-05-26
Job specializations:
  • Software Development
    AI Engineer (Applied/Software), Cloud Engineer - Software
Salary/Wage Range or Industry Benchmark: 200000 - 235000 USD Yearly USD 200000.00 235000.00 YEAR
Job Description & How to Apply Below
Position: Senior Software Engineer, AI/ML (Infrastructure & Platform)
Location: New York

Location
:
Hybrid, New York, Tempe, San Francisco

Employment Type
:
Full time

Location Type
:
Hybrid

Department
:
Technology

Compensation
:

  • Salary $200K – $235K
    • Offers Equity

Role
:
Software Engineer, AI/ML (AI Infrastructure & Platform)

Location
:
Hybrid, NYC

About Us

is the industry’s leading estate planning platform, empowering more than 1,000 wealth management firms to modernize how they talk about estate planning with their clients. As the only tech‑led, end‑to‑end platform built specifically for financial institutions,  enables firms to drive scale, efficiency, and measurable client impact. Trusted by some of the largest names in finance,  combines proprietary AI, robust security, and deep technological and legal expertise to serve the full range of client needs, from foundational plans to the most sophisticated estate strategies.

The company has been widely recognized for innovation and leadership, winning Top Estate Planning Technology and Top Estate Planning Implementation at the 2025  Industry Awards, being named the 2024 Best Technology Provider in the Trust category, and earning #1 in estate planning market share in the 2025 Kitces Advisor Tech Study.

Our team is fundamental to our standing as the leading estate planning platform. We cultivate a collaborative and supportive environment, fostering innovation and making  a truly enjoyable workplace.  is proud to be certified as a Great Place to Work for 2025.

The Role

We are seeking a Software Engineer, AI/ML (Infrastructure & Platform) to build the foundational systems that power our next generation of AI applications.

This is a systems-focused role. You will design and build the platforms, abstractions, and infrastructure that enable teams to reliably develop, deploy, and scale AI systems — including agentic workflows, retrieval pipelines, and model integrations.

You will operate at the intersection of AI systems and distributed infrastructure, focusing on the “how” behind production AI: how models are orchestrated, how tools/skills are exposed and executed, and how systems are evaluated, monitored, and scaled in real‑world environments.

Your work will directly enable product teams to move faster while ensuring our AI systems are reliable, observable, secure, and cost‑efficient.

What You Will Do Build core AI infrastructure
  • Design and implement platforms for LLM orchestration, tool execution, and agent workflows
  • Develop shared services and abstractions used across multiple AI applications
Build AI capability layers (tools / skills)
  • Design and implement tools (“skills”) that agents and applications rely on, including APIs, workflows, and integrations
  • Define clear interfaces for capabilities such as data retrieval, calculations, document processing, and external system actions
  • Build reusable, composable abstractions that enable safe and scalable tool usage across systems
  • Ensure tools are reliable, observable, and secure, especially when interacting with sensitive data
Enable agentic systems at scale
  • Build infrastructure to support multi‑step agents (state management, tool routing, retries, failure handling)
  • Design systems where agents reason over and invoke tools/skills reliably
  • Create reusable orchestration patterns between models and capabilities
Develop evaluation and observability systems
  • Build frameworks for offline and online evaluation of AI systems
  • Implement logging, tracing, and monitoring for model behavior and system performance
Own reliability and performance
  • Design systems for high availability, fault tolerance, and graceful degradation
  • Optimize for latency, throughput, and cost across AI workloads
Build data and retrieval infrastructure
  • Develop scalable RAG pipelines, indexing systems, and data processing workflows
  • Own infrastructure for handling large‑scale structured and unstructured data
Create internal platforms and developer tooling
  • Build tools, SDKs, and internal platforms that enable engineers to integrate AI capabilities quickly and safely
  • Standardize best practices across teams (prompting, evaluation, deployment)
Work closely with product and AI teams
  • Partner with AI Applications engineers to support production use cases
  • Translate product needs into…
Position Requirements
10+ Years work experience
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
 
 
 
Search for further Jobs Here:
(Try combinations for better Results! Or enter less keywords for broader Results)
Location
Increase/decrease your Search Radius (miles)
0
200
Filters
Education Level
Experience Level (years)
Posted in last:
Salary