Software Engineer III​/Senior, AI Gateway

Software Engineer III/Senior, AI Gateway

About ngrok Inc.

At ngrok, we believe that doing networking the right way should also be the easy way. Over the last 10 years, we’ve provided developers with simple interfaces for getting traffic into their apps and APIs, without legacy proxies, external load balancers, or VPNs. ngrok is used by millions of developers at top brands as part of their standard stack.

The Opportunity

As a Software Engineer on the AI Gateway Team, you’ll shape how developers and enterprises securely connect their applications through ngrok. This role involves designing and implementing distributed systems that enforce policies, manage trust, and deliver advanced endpoint capabilities at global scale.

You’ll tackle challenges that require technical depth and creativity: building high-performance distributed systems that route traffic with millisecond precision, securing sensitive workloads, and enabling AI-driven applications. Your work will influence how developers build, secure, and scale their critical services on ngrok.

Remote position for candidates outside the Bay Area; hybrid role for those within commuting distance to San Francisco. Our Bay Area employees commute to the office on Tuesdays and Wednesdays. ngrok is unable to provide visa sponsorship for this position. Applicants must be authorized to work in the United States on a permanent, ongoing basis without sponsorship.

What You’ll Do

• Build and evolve the gateway services that handle traffic routing and policy enforcement.

• Implement new traffic policy objects (e.g., secrets, IP rules, mTLS/CA policies) to give customers fine-grained control over their applications.

• Extend and optimize endpoint services that provide reliability and observability for developers.

• Partner with product, platform, and security teams to ensure traffic management is robust, scalable, and enterprise-ready.

• Write clean, high-quality, well-tested code and participate in thoughtful design and code reviews.

• Investigate and resolve production issues across distributed systems.

• Continuously improve the developer experience—simplifying how teams configure, secure, and scale their traffic.

• Contribute to the evolution of shared infrastructure, tools, and libraries across ngrok.

You Are a Good Fit If You…

• Have 3+ years of experience writing high-quality production software in Go or languages like Rust, C, Java, or C++.

• Understand networking and distributed systems fundamentals (protocols, TLS/mTLS, proxies, load balancers, traffic shaping).

• Have experience building AI gateways, reverse proxies, API gateways, or working with AI/ML service traffic.

• Are motivated by building scalable, performant systems that developers love to use.

• Enjoy working at the intersection of infrastructure, security, and developer tooling/experience.

• Value pragmatism—delivering solutions that balance complexity with simplicity and maintainability.

Compensation

Senior Software Engineer

• Tier 1 (SF, LA, Seattle, NYC): $180,000 – $225,000

• Tier 2 (rest of US): $165,600 – $207,000

Software Engineer III

• Tier 1 (SF, LA, Seattle, NYC): $160,000 – $200,000

• Tier 2 (rest of US): $147,200 – $184,000

Job level and actual compensation are evaluated based on qualifications, interview performance, scope of role, internal equity, market data, and work location. We offer a competitive mix of salary and equity.

#LI-Hybrid

We are an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or protected veteran status.

Benefits

• 401(k) with company match

• Healthcare, dental, and vision insurance with premiums fully covered on the base plan for employees; partial coverage for dependents

• Unlimited PTO with encouragement to take more than four weeks

Equal Opportunity and Legal

We are committed to building a diverse and inclusive team. ngrok is a federal contractor/subcontractor and participates in voluntary self-identification programs. All information provided is confidential and used solely for compliance reporting where permitted by law.

#JLjbffr