Senior Software Engineer; AI Infra + Systems

$170000 - $200000 per year | Atlanta, GA | Remote | Permanent

We’re an early-stage AI startup on a mission to redefine how users interact with intelligent systems. We’re building something brand new and we’re looking for talent to help us scale our platform services.

• Fully Remote
• Well-funded
• Senior team of proven engineers
• Autonomy and upward mobility
• Competitive compensation
• Lucrative Equity
• Great healthcare benefits

This position focuses on improving the performance, reliability, and efficiency of AI-powered applications while expanding the organization’s model-serving capabilities. You’ll work across backend engineering, distributed systems, and production AI infrastructure, with an emphasis on optimizing inference performance, reducing latency, and evaluating opportunities to move from managed AI services toward self-hosted models.

• Build & Maintain AI Backend Services:
  Develop and optimize production microservices using Python and Scala, supporting AI integrations, application APIs, and distributed backend systems.
• Improve Scalability & Performance:
  Identify and eliminate bottlenecks involving latency, concurrency, throughput, and resource utilization across high-traffic applications.
• Optimize Model Inference:
  Evaluate and implement model-serving architectures, including self-hosted inference, GPU utilization, autoscaling, and cost optimization.
• Own Production Reliability:
  Manage the performance, monitoring, deployment, and operational health of AI services running in Kubernetes.
• Drive Technical Improvements:
  Collaborate across engineering teams to improve system architecture, measure performance, and deliver scalable AI capabilities.

• 5 + years of experience minimally. Fluent on the backend with Python and Scala
• Experience designing, developing, and maintaining distributed systems and microservices in production.
• Hands-on experience with Kubernetes, containerized applications, and cloud infrastructure.
• Demonstrated ability to diagnose and resolve performance bottlenecks involving latency, concurrency, and system throughput.
• Experience deploying or operating ML models through production APIs, with an understanding of inference performance.
• Practical knowledge of MLOps principles related to model serving, monitoring, deployment, and operational reliability.
• Familiarity with LLM-powered applications and the backend architecture supporting generative AI systems.
• Strong understanding of production observability, including logging, metrics, tracing, and performance monitoring.

Jobot is an Equal Opportunity Employer. We provide an inclusive work environment that celebrates diversity and all qualified candidates receive consideration for employment without regard to race, color, sex, sexual orientation, gender identity, religion, national origin, age (40 and over), disability, military status, genetic information or any other basis protected by applicable federal, state, or local laws. Jobot also prohibits harassment of applicants or employees based on any of these protected categories.

It is Jobot’s policy to comply with all applicable federal, state and local laws respecting consideration of unemployment status in making hiring decisions.

Sometimes Jobot is required to perform background checks with your authorization. Jobot will consider qualified candidates with criminal histories in a manner consistent with any applicable federal, state, or local law regarding criminal backgrounds, including but not limited to the Los Angeles Fair Chance Initiative for Hiring and the San Francisco Fair Chance Ordinance.

Information collected and processed as part of your Jobot candidate profile, and any job applications, resumes, or other information you choose to submit is subject to Jobot's Privacy Policy, as well as the Jobot California Worker Privacy Notice and Jobot Notice Regarding Automated Employment Decision Tools which are available at

By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from Jobot, and/or its agents and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here: