Software Engineer, Cortex AI Infrastructure

At Snowflake, we are building the future of AI for enterprise data. The Cortex Apps team focuses on backend infrastructure that powers flagship products like Snowflake Intelligence, Cortex Agents, and Search.

• Architect Agentic Runtimes:
  Build and scale orchestration engines that execute complex agentic workflows, ensuring low-latency tool execution and robust state management.
• Scale Context Engineering Infra:
  Design high-performance systems for Retrieval-Augmented Generation, including vector database integration, scalable search indexing, query processing, result ranking, semantic caching, and automated metadata extraction.
• Build the "Evals Engine":
  Develop automated infrastructure to run massive-scale golden set simulations, error analysis pipelines, and hillclimbing experiments.
• Productionize AI Workflows:
  Collaborate with the modeling team to convert raw LLM capabilities into hardened, multi-tenant microservices with strict guardrails and observability.
• Optimize Performance & Cost:
  Direct infra strategy for model routing, prompt caching, and token optimization to ensure efficient AI features.

• Education:
  
  Bachelor’s degree in Computer Science or related technical field.
• Experience:
  
  5+ years building distributed systems, high-throughput APIs, or backend infrastructure for AI/ML products.
• Technical Stack:
  Deep proficiency in Go or Java for systems and Python for AI orchestration.
• Systems Thinking:
  Strong understanding of database internals, distributed state management, and cloud-native architecture (Kubernetes, Foundation
  
  DB, etc.).
• Domain Expertise:
  Familiarity with vector indices, agent platforms, and building scalable data pipelines.

• Query optimization and SQL engine internals.
• Designing multi-tenant systems for sensitive enterprise data at scale.
• Developing search infrastructure for large-scale applications.
• Direct experience with any of the subsystems outlined above.

The estimated base salary range for this role is $236,000 - $309,750. Additionally, this role is eligible to participate in Snowflake’s bonus and equity plan.

The role includes a competitive benefits package that includes medical, dental, vision, life and disability insurance; 401(k) retirement plan; flexible spending & health savings account; at least 12 paid holidays; paid time off; parental leave; employee assistance program; and other company benefits.