×
Register Here to Apply for Jobs or Post Jobs. X

Software Development Engineer - Enterprise AI Infrastructure

Job in Durham, Durham County, North Carolina, 27703, USA
Listing for: GRAIL
Full Time position
Listed on 2026-07-24
Job specializations:
  • IT/Tech
    AI Engineer (Applied/Software)
Salary/Wage Range or Industry Benchmark: 147000 - 224000 USD Yearly USD 147000.00 224000.00 YEAR
Job Description & How to Apply Below
Position: Staff Software Development Engineer - Enterprise AI Infrastructure - #4898

Our mission is to detect cancer early, when it can be cured. We are working to change the trajectory of cancer mortality and bring stakeholders together to adopt innovative, safe, and effective technologies that can transform cancer care.

We are a healthcare company, pioneering new technologies to advance early cancer detection. We have built a multi‑disciplinary organization of scientists, engineers, and physicians and we are using the power of next‑generation sequencing (NGS), population‑scale clinical studies, and state‑of‑the‑art computer science and data science to overcome one of medicine’s greatest challenges.

GRAIL is headquartered in the Bay Area of California, with locations in Washington, D.C., North Carolina, and the United Kingdom. It is supported by leading global investors and pharmaceutical, technology, and healthcare companies.

For more information, please visit

The Staff Software Development Engineer – Enterprise AI Infrastructure is a senior technical role responsible for leading the design, development, and scaling of a centralized, highly governed enterprise AI platform. This position serves as a technical expert focused on AWS and Kubernetes‑based (EKS) AI infrastructure, agentic development, and multi‑agent orchestration operating within a regulated environment. The Staff Engineer partners closely with cross‑functional stakeholders across Software Engineering, Data Science, Security, Regulatory Affairs, and Product to build a unified control plane that securely connects large language models with enterprise tools and company knowledge.

This role is expected to drive technical excellence in cloud infrastructure, container orchestration, AI governance, identity‑scoped integrations, and agentic workflows while mentoring engineering teams and advancing the organization’s enterprise AI strategy.

This role is based in Menlo Park, California, and will move to Sunnyvale, California in Fall 2026 OR Durham, NC. It offers a flexible work arrangement, with the ability to work from GRAIL’s office or from home. Our current flexible work arrangement policy requires that a minimum of 60%, or 24 hours, of your total work week be on‑site. Your specific schedule, determined in collaboration with your manager, will align with team and business needs and could exceed the 60% requirement for the site.

At our Menlo Park campus, Tuesdays and Thursdays are the key days where we encourage on‑site presence to engage in events and on‑site activities.

Responsibilities
  • Lead the end‑to‑end design, development, deployment, and monitoring of a scalable, governed enterprise AI platform leveraging Amazon EKS and AWS native services (e.g., Bedrock, Open Search Serverless, KMS, VPC).
  • Design and implement agentic AI workflows, specialized autonomous agents, and multi‑agent systems using advanced LLM orchestration techniques and agent frameworks.
  • Architect and manage secure integrations using the Model Context Protocol (MCP) to connect the AI platform with internal systems, vector databases, and third‑party SaaS applications (e.g., Google Workspace, Slack).
  • Build and enforce strict identity, authorization, and zero‑trust token brokering flows leveraging Okta, Auth0, and custom JWT authorize rs to ensure secure, least‑privilege tool execution.
  • Implement deterministic policy controls (e.g., Cedar policy engine) to enforce role‑based access, approval gates, and human‑in‑the‑loop checks at the API gateway level.
  • Develop and maintain highly isolated, scalable containerized runtime environments (e.g., Kubernetes pods on Amazon EKS) for secure AI model execution, tool usage, and knowledge retrieval.
  • Establish and maintain comprehensive audit trails and observability for all AI interactions, utilizing AWS Cloud Trail and GenAI observability tools (e.g., Open Telemetry) to track cost, latency, and tool calls.
  • Collaborate with Product Management, Security, Regulatory, and business stakeholders to translate enterprise requirements into scalable, compliant AI infrastructure solutions.
  • Troubleshoot and resolve complex technical issues involving cloud infrastructure, Kubernetes networking, network isolation (Private Link), and…
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
 
 
 
Search for further Jobs Here:
(Try combinations for better Results! Or enter less keywords for broader Results)
Location
Increase/decrease your Search Radius (miles)
0
200
Filters
Education Level
Experience Level (years)
Posted in last:
Salary