Senior Software AI Engineer

Headquarters: Minneapolis, MN
URL: (Use the "Apply for this Job" box below)..ai

Collaboration.

Ai is a mission-focused, AI-powered software and services company based in Minnesota, with employees, partners, and customers around the world. We unite people, technology, and purpose to accelerate breakthroughs that transform industries, empower communities, and create a more sustainable future. We collaborate with organizations across the defense ecosystem, helping them navigate complex challenges and drive transformative change.

NetworkOS — NetworkOS is an AI-powered platform that aligns people, purpose, ideas, and expertise in real-time, generating actionable insights to propel movements forward.

Crowd Vector — Crowd Vector is an integrated solution marketplace and innovation management platform that rapidly uncovers new ideas and advances breakthroughs to fuel movements.

To learn more about us, visit collaboration.ai.

You'll build the agentic systems and data pipelines behind NetworkOS's AI capabilities: production agent workflows built on industry-leading agent SDKs and harnesses, MCP servers, and Agent Skills standards; the eval and observability layer that keeps LLM quality measurable; and the ingestion pipelines that turn messy, diverse data sources into queryable knowledge.

This is an execution seat, not an ivory tower. You'll commit code every week, ship agents as product capability rather than demos, and help shape a roadmap that's heading deep into graph + agents territory — for customers in defense, public sector, and regulated enterprise.

Agents in production. Pipelines that hold. Evals that keep everyone honest.

• Ship production agent systems — design, build, and operate agentic workflows (agent SDKs, MCP servers, Agent Skills standards) powering AI-driven matching, analysis, and data intelligence

• Operationalize LLM quality — build the eval and observability layer with Langfuse, golden datasets, LLM-as-judge patterns, and Fin Ops-style tracking so every workflow has measurable quality, cost, and latency

• Engineer data pipelines — robust ingestion of documents, structured data, and external sources into searchable knowledge bases with quality validation, deduplication, and incremental updates

• Own retrieval quality — hybrid search combining vector, keyword, and metadata retrieval, continuously improved through reranking, query expansion, and contextual compression

• Accelerate with AI — build custom MCP tools and Agent Skills that make the whole engineering team measurably faster

• Execute alongside the team — pair with full-stack engineers on AI integration points, contribute to incident response for AI services, and keep your hands in the code

• Languages:
  
  Python (primary);
  Kotlin (core platform language at CAI);
  Type Script/Node.js and other modern languages (secondary)

• AI/ML:
  FastAPI, Pydantic; multi-provider LLM SDKs (Anthropic, OpenAI, and others)

• Agentic Tooling:
  Claude Code/Codex/etc.; industry-leading agent SDKs and harnesses; MCP servers;
  Agent Skills standards

• LLM Operations:
  Langfuse + evals (golden datasets, LLM-as-judge); in-house Fin Ops tracking (token usage, latency, cost); multi-provider orchestration including AWS Bedrock

• Search & Retrieval:
  Vector databases, Open Search, embedding models

• Data:
  PostgreSQL, Amazon S3; streaming pipelines (Kafka/Kinesis) where needed

• Infrastructure:
  Docker, Kubernetes (AWS EKS);
  Data Dog + Open Telemetry observability

• 7+ years of professional software engineering experience, with 3+ years focused on AI/ML or data engineering

• Production agentic/LLM application experience — built and operated systems around LLM APIs (Anthropic, OpenAI) serving real users: agents, tool-use, or orchestrated LLM workflows

• Data engineering background — robust, scalable pipelines for AI/ML workloads

• LLM operations experience — evals and observability for production LLM systems (quality, cost, latency)

• Production retrieval experience — vector databases and/or search engines (Open Search, Elasticsearch)

• Modern Python stack proficiency — FastAPI, Pydantic, async/await, modern dependency management

• AI-native workflows —…