×
Register Here to Apply for Jobs or Post Jobs. X

Software Engineer - AI Products agent prototype​/building

Job in Philadelphia, Philadelphia County, Pennsylvania, 19117, USA
Listing for: starlims
Full Time position
Listed on 2026-10-09
Job specializations:
  • Software Development
    AI Engineer (Applied/Software), Backend Developer
Salary/Wage Range or Industry Benchmark: 140000 - 200000 USD Yearly USD 140000.00 200000.00 YEAR
Job Description & How to Apply Below
About the Role:

We're building AI into STARLIMS, a platform used across quality manufacturing, life sciences, public health, forensics, and environmental sciences.

This role is focused on agentic systems: software that reasons over a task, calls tools, works through multiple steps, and hands the result to a person to review and approve.

Our users work under strict accuracy, traceability, and validation requirements. The engineering challenge is making non-deterministic systems reliable, observable, and controllable enough to be trusted, tested, and shipped.

You'll work on both the platform and runtime our agents execute on and the production agents built on top of it.

What You'll Work On:

Agent Platform & Runtime (Core Focus)
  • Design and build the runtime our agents execute on: planning and execution loops, tool calling, state management, durable execution, and failure recovery
  • Build the layer through which agents reach platform data and external systems safely
  • Design coordination, delegation, and handoff across agents and workflows where needed
  • Make agent behaviorversionable, testable, measurable, and regression-safe across releases
  • Build reusable primitives so new agents are configured rather than rebuilt from scratch
Building Agents (Core Focus)
  • Take a domain workflow from expert conversation to a working agent: goals, actions, execution flow, failure handling, and success criteria
  • Ground agent decisions and outputs in authoritative enterprise data rather than relying on model knowledge alone
  • Implement human-in-the-loop by design, including approval gates, override capture, uncertainty handling, and clear evidence for agent decisions. Agents recommend and draft; people decide
  • Close the loop: turn user corrections and overrides into signals that measurably improve the agent
Evaluation & Reliability
  • Build evaluation harnesses for multi-step behavior, not single-response accuracy: task completion, tool-call correctness,groundedness, trajectory quality, and regression across model, prompt, and tool changes
  • Define production metrics for agent quality, reliability, latency, cost, and human intervention rates
  • Implement guardrails, fallbacks, timeouts, cost ceilings, and end-to-end observability and tracing across agent runs
  • Design safeguards against prompt injection, unsafe tool use, excessive permissions, data leakage, and other agent-specific security risks
  • Manage prompt evolution, model drift, and non-determinism while maintaining consistent, measurable system behavior across releases
Integration & Data
  • Integrate agents with platform APIs and third-party enterprise systems already running in our customers' environments
  • Build retrieval and context pipelines that turn fragmented enterprise data into reliable, permission-aware agent context
  • Design controlled execution paths for automated actions, with a complete, traceable audit trail
Platform & Infrastructure
  • Build and operate backend services on AWS (Lambda, API Gateway, DynamoDB, Step Functions, etc.)
  • Own significant parts of the system architecture and contribute to key technical decisions
  • Contribute to infrastructure-as-code and deployment pipelines
Tech Stack
  • Languages:

    Type Script, Python
  • Backend:

    Node.js, Python, AWS Lambda, Step Functions
  • AI:

    OpenAI, Anthropic, MCP and related agent/tool protocols, embeddings and vector search
  • Frontend:

    React, Next.js, Tailwind CSS
  • Infrastructure:

    AWS, Terraform
  • Testing:

    Jest, Playwright,pytest
What We're Looking For Must Have
  • 6+ years of software engineering experience, including production systems
  • Experience building production LLM systems, including tool-using or multi-step agentic workflows beyond simple prompting and chat interfaces
  • Strong understanding of LLM behavior, limitations, and failure modes, especially how errors compound…
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
 
 
 
Search for further Jobs Here:
(Try combinations for better Results! Or enter less keywords for broader Results)
Location
Increase/decrease your Search Radius (miles)
0
200
Filters
Education Level
Experience Level (years)
Posted in last:
Salary