Sr. Software Engineer, AI

We're looking for a Sr. Software Engineer, AI to own the machine learning and AI efforts across our platform. You'll work directly with our CTO to define and build AI-powered features that will shape Agent North, our customer-facing AI assistant, as well as drive advancements in cost and usage forecasting, financial modeling, and multi-service provider rightsizing.

This is a hands-on, senior-level role — perfect for someone who thrives in a fast-moving startup environment, has built ML-powered products before, and is comfortable taking a project from 0 to 1. If you're a high-energy, motivated engineer passionate about LLMs, cloud infrastructure, and deploying AI systems at scale, we'd love to hear from you.

• Design, build, and deploy ML models for cloud automation and optimization.
• Work with LLMs, fine-tuning, optimizing, and integrating them into our platform.
• Develop AI chatbots and customer-facing AI solutions to automate and enhance cloud finance management.
• Ensure security and compliance in AI model deployment, implementing best practices for secure AI infrastructure.
• Set up and maintain ML infrastructure across GCP, AWS, and Azure, optimizing for scale and efficiency.
• Drive ML project development from 0 to 1, making key decisions on architecture, tooling, and implementation.
• Collaborate with engineering, product, and leadership teams to align AI development with business goals.
• Experiment with and implement cutting-edge ML techniques, including prompt engineering, model security, continuous evaluation, and monitoring frameworks.
• Provide thought leadership, driving AI strategy and identifying opportunities to improve and expand North's AI capabilities.

• 5+ years of hands‑on experience in ML, AI model development, and infrastructure deployment.
• Experience deploying ML models at scale on AWS (cloud-based, distributed systems, or edge deployments).
• Strong programming skills in Python and SQL, with demonstrated ability to write production-quality code.
• Proficiency with ML frameworks and the judgment to determine when and where to apply them based on data complexity.
• Ability to move fast and iterate, taking ideas from concept to production.
• Comfortable with Git.
• Excellent communication skills, with the ability to clearly convey progress, methodology, solution approach, and results.
• Strong analytical background, capable of sifting through complex cost patterns and making sense of intricate financial cloud modeling.

• Experience working in a startup.
• Experience working with financial cloud data across GCP, AWS, or Azure, or complex large financial and logging datasets.
• Experience deploying models in Amazon Bedrock or on AWS.
• Experience deploying infrastructure with Terraform.
• AWS technical certification (or equivalent cloud certification).

• Hybrid role based in New York City, with an office in Dumbo, Brooklyn.
• Unlimited PTO
• 16-week fully paid parental leave (20 weeks at 50% for mothers)
• Company-wide breaks: last week of August & Dec 23–Jan 3
• The opportunity to participate in company benefits, including a Medical PPO Plan with majority of the premium covered by North.
• 30-day sabbatical every 4 years

$230,000 – $270,000 base salary, depending on experience Equity included

If you're a ML engineer who loves building AI-powered products, deploying at scale, and shaping the future of cloud financial automation, we'd love to hear from you.