Software Engineer, AI Engineer (Applied​/Software), Backend Developer

Are you ready to shape the future of internal development workflows at a leading technology company? We’re seeking a visionary Software Engineer to join a dynamic team dedicated to building a groundbreaking centralized AI platform. This is an unparalleled opportunity to make a profound impact, empowering every engineering team with safe, governed, and cost-aware AI agents, fundamentally transforming how they build and deliver solutions.

Your contributions will directly enhance developer productivity, streamline operations, and drive innovation across the organization, making complex AI capabilities accessible and impactful for everyone.

As a key contributor, you will be at the forefront of designing, building, and extending a shared platform that integrates cutting-edge AI agent technology into development pipelines. You’ll architect robust, scalable solutions that enable teams to leverage AI without extensive re-architecture, setting new standards for efficiency and intelligent automation.

• Architect and implement sophisticated agent orchestration systems, including router functions, queueing mechanisms, and agent invocation services.
• Seamlessly integrate AI agent capabilities into modern CI/CD platforms, designing pipeline configuration patterns where agent invocations execute as stages, process context from code changes, produce artifacts, and control subsequent stages based on AI agent outcomes.
• Develop and expand a suite of shared, tool-based functions that empower AI agents with versatile capabilities.
• Design and implement advanced knowledge bases, leveraging powerful search and storage technologies to ensure AI agents can reason over a comprehensive, shared organizational context rather than isolated prompts.
• Implement robust AI guardrails, including input/output filters, sensitive data scrubbing, content moderation, and fine-grained, per-agent permission boundaries, ensuring secure and compliant AI operations by design.
• Develop and integrate Token Ops controls for efficient resource management, encompassing model tiering and intelligent routing via an LLM gateway, semantic caching, and optimized context-window management.
• Instrument the entire AI platform with comprehensive observability, including dashboards, audit trails, and detailed trace logging for every agent invocation (input, output, decision, tokens, cost) to ensure compliance, facilitate debugging, and provide deep operational insights.
• Required Qualifications:
• 3–7 years of professional experience in software development.
• Strong proficiency in Python and the Python SDK for building production-grade serverless functions and event-driven services.
• Solid experience with cloud-based services, including serverless compute, API management, messaging queues, event buses, identity and access management, secrets management, and monitoring tools.
• Specific experience with AI agent services, action groups, knowledge bases, and guardrails.
• Hands‑on experience integrating with large language model (LLM) APIs, such as those from leading providers or similar platforms.
• Familiarity with CI/CD platforms and best practices.
• A strong security mindset, including expertise in least‑privilege access, secure secrets handling, input validation, and an awareness of prompt injection and data-leak risks in LLM workflows.
• Comfortable with observability principles, including structured logging, metrics, tracing, and writing highly debuggable code for production environments.

• Experience with vector search and Retrieval-Augmented Generation (RAG), including vector databases, embeddings, and retrieval evaluation.
• Familiarity with Fin Ops or Token Ops concepts, such as cost attribution, intelligent model routing, semantic caching, and batch inference.
• Experience building developer platforms or internal tooling that other engineers rely on daily.
• Familiarity with advanced AI agent frameworks and an understanding of their architectural tradeoffs.

• You excel at crafting small, focused services with clear contracts, prioritizing modularity over monolithic architectures.
• You champion extensibility as a core feature, ensuring…