×
Register Here to Apply for Jobs or Post Jobs. X

AI Backend Engineer

Job in New York, New York County, New York, 10261, USA
Listing for: ByteHire Limited.
Full Time position
Listed on 2026-10-19
Job specializations:
  • Software Development
    Backend Developer, AI Engineer (Applied/Software), Cloud Engineer - Software, Software Architect
Salary/Wage Range or Industry Benchmark: 250000 USD Yearly USD 250000.00 YEAR
Job Description & How to Apply Below
Position: Staff AI Backend Engineer
Location: New York

Salary:

up to $250,000 per annum + bonus

About The Client:

They are building an AI-powered care orchestration platform designed to unify fragmented healthcare systems and improve patient outcomes  platform combines agentic AI workflows with a robust backend infrastructure to automate complex clinical and operational processes.

The product is backed by significant early-stage funding and led by operators with experience scaling healthcare and technology platforms nationally. The focus is on delivering a production-grade, patient-facing AI system that operates reliably in high-stakes environments.

They are looking for staff-level engineers to help design, build, and scale the backend systems that power the platform.

They operate as a high-performing engineering team focused on delivering high-quality, impactful systems. Their values include:

Engineering Excellence:
Strong ownership of technical quality, performance, and reliability

Impact-Driven Development:
Building systems that solve real-world problems at scale

Continuous Growth:
Learning, mentorship, and raising the bar across the team

Responsibilities

As a Staff Backend AI Engineer, you will design, build, and operate the backend AI systems that power Arbiter’s intelligent care orchestration platform. You will own critical parts of our agentic infrastructure, from low-latency inference pipelines to workflow automation and service orchestration, working closely with product, data, and clinical partners to ship production-grade AI systems with real customer dependency.

Build the Agentic Platform:
Design, develop, and operate backend systems powering agent-driven workflows, including orchestration layers, inference pipelines, and automation primitives

Production AI Systems:
Ship and maintain production-grade AI systems automating complex clinical and administrative workflows with strict reliability and latency requirements

Platform Architecture & Scalability:
Contribute to architecture with a focus on modularity, extensibility, and integration with EMRs, data systems, and external services

Inference & Backend Reliability:
Ensure high performance, low latency, and fault tolerance across backend services and AI pipelines

Infrastructure & Deployment:
Implement best practices across CI/CD, testing, observability, and production deployments

Cross-Functional Execution:
Partner with data scientists, product, and clinical teams to translate complex problems into scalable systems

Technical Leadership & Mentorship:
Raise the engineering bar through mentorship, standards, and technical direction

Ownership & On-Call:
Own systems end-to-end, including incident response and operational excellence

Skills & Experience

Strong experience building complex production systems in Python, with a focus on scalability and reliability

Proven ability to design and operate highly scalable, distributed systems in production

Deep expertise in event-driven architectures, concurrency (multi-processing, multi-threading, async), and distributed system design

Strong experience designing and building distributed services (REST and/or gRPC) and service-oriented architectures

Experience designing data processing pipelines, including intelligent decision‑making systems and workflow orchestration

Hands-on experience building AI-powered systems, including LLM integrations and understanding trade-offs (latency, cost, accuracy)

Experience implementing agentic workflows or finite state machines for complex, multi-step processes

Strong experience with metrics, observability, and evaluation systems to measure reliability, performance, and scalability

Experience working with large-scale data processing and analytics (e.g. pandas, Big Query or similar)

Solid experience with PostgreSQL and data modelling at…

To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
 
 
 
Search for further Jobs Here:
(Try combinations for better Results! Or enter less keywords for broader Results)
Location
Increase/decrease your Search Radius (miles)
0
200
Filters
Education Level
Experience Level (years)
Posted in last:
Salary