Senior Engineering Manager, AI
Listed on 2026-08-10
-
Software Development
AI Engineer (Applied/Software), Software Architect, DevOps
About Alpha Sense:
The world’s most sophisticated companies rely on Alpha Sense to remove uncertainty from decision‑making. With market intelligence and search built on proven AI, Alpha Sense delivers insights that matter from content you can trust. Our universe of public and private content includes equity research, company filings, event transcripts, expert calls, news, trade journals, and clients’ own research content.
The acquisition of Tegus by Alpha Sense in 2024 advances our shared mission to empower professionals to make smarter decisions through AI‑driven market intelligence. Together, Alpha Sense and Tegus will accelerate growth, innovation, and content expansion, with complementary product and content capabilities that enable users to unearth even more comprehensive insights from thousands of content sets. Our platform is trusted by over 6,000 enterprise customers, including a majority of the S&P 500.
Founded in 2011, Alpha Sense is headquartered in New York City with more than 2,000 employees across the globe and offices in the U.S., U.K., Finland, India, Singapore, Canada, and Ireland. Come join us!
About the Role:
To support our growth, we are searching for a Senior Engineering Manager to lead the AI Platform team. This group builds and operates our core AI Gateway, serving as the critical high‑throughput highway for all Large Language Model (LLM) traffic across the entire Alpha Sense ecosystem. The right leader will bring deep experience running high‑performance teams, a strong background in distributed system architecture, and hands‑on familiarity with multi‑vendor integrations.
Superior communication and strategic collaboration skills are critical for managing expectations and aligning stakeholders across the entire R&D organization.
- Proven Engineering Leadership:
Strong track record of managing and growing high‑performing teams of senior and staff engineers, with a passion for developing technical leaders and aligning engineering objectives with business strategy. - Enterprise Scale
Experience:
Seasoned background in designing, building, and operating high‑throughput, low‑latency distributed systems (specifically handling complex routing, caching, queueing, or rate limiting). - Technical Thought Leadership:
Ability to deeply engage in high‑level architectural discussions, provide constructive technical direction, and deliver high‑impact feedback during architectural reviews. - Strategic Communication:
Exceptional communication and partnership skills to align diverse engineering, product, and executive partners across the R&D organization. - Modern Tooling & AI‑First Mindset:
Active embrace of AI tools in developer workflows, with an expectation for the team to leverage AI in their tool chains to maximize engineering velocity. - Relevant Tech Stack Experience (Nice to Have):
Experience in the applied AI space or working with frameworks and tools such as Lang Chain, Lang Graph, LiteLLM, or Open Router. - Experience with orchestrators and proxies like Temporal, Envoy, or similar enterprise‑grade gateway technologies.
- Experience with Python, Java, and highly distributed caching/queueing systems.
- Strategic Team Leadership:
Manage, mentor, and grow a highly talented team of up to 10 senior and staff software engineers (mostly distributed across North America). - Foster a high‑performance culture of technical excellence, predictable delivery, and career growth.
- High‑Scale Operations & Scaling:
Own the strategy and architecture of our enterprise AI Gateway - currently processing up to 1 Trillion LLM tokens per week with a projected 10x growth surge driven by agentic workflows (such as Super Analyst) - while ensuring high availability, sub‑millisecond routing, caching, queueing, and robust fallback mechanisms. - Multi‑Vendor Orchestration:
Strategically guide the integration, evaluation, and management of 6+ major LLM vendors and 50+ distinct models, optimizing for latency, cost, and reliability across different providers. - Cross‑Functional Alignment:
Partner closely with product management, AI research teams, and executive engineering leads to align the gateway's roadmap with core product…
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).