Software Engineer, Backend Developer, Cloud Engineer - Software

About Realm Labs

Realm Labs is building the infrastructure that makes AI safe for enterprises. Our platform helps organizations securely deploy, monitor, and govern AI applications through real-time detection, policy enforcement, and security controls.

Our systems process billions of AI tokens across production workloads and solve challenging problems in distributed systems, inference infrastructure, security, and developer tooling.

We’re a small, engineering-driven team where every engineer owns meaningful pieces of the product and works directly with customers.

As a Software Engineer at Realm Labs, you’ll build production systems that power enterprise AI deployments. Your work will span backend services, distributed systems, infrastructure, and customer-facing features.

Responsibilities include:

• Design and build scalable backend services in Python or Go.
• Develop APIs and internal services used by enterprise customers.
• Work with distributed systems, asynchronous processing, and message queues.
• Design efficient database schemas and optimize query performance.
• Build reliable integrations with cloud services and AI platforms.
• Debug production issues and improve system reliability and observability.
• Collaborate closely with product, infrastructure, and AI engineers to ship features quickly.
• Participate in code reviews and help maintain a high engineering bar.

Required

• 2+ years of professional software engineering experience.
• Strong programming skills in Python, Go, Java, C++, or a similar language.
• Solid understanding of computer science fundamentals, including:
  • Data structures and algorithms
  • Operating systems
  • Concurrency and multithreading
• Experience designing and consuming REST or gRPC APIs.
• Experience working with relational databases such as PostgreSQL or MySQL.
• Understanding of distributed systems concepts such as replication, consistency, caching, partitioning, queues, and fault tolerance.
• Experience with cloud platforms (AWS, GCP, or Azure).
• Strong debugging and problem-solving skills.
• Excellent communication skills and ability to work in a fast-moving startup.

Nice to Have

• Experience building distributed systems at scale.
• Experience with Docker and Kubernetes.
• Familiarity with Redis, RabbitMQ, Kafka, or similar technologies.
• Experience with observability tools (Open Telemetry, Prometheus, Grafana).
• Experience with AI/LLM infrastructure.
• Experience working in startups or shipping customer-facing products.

You don’t need experience with everything below, but you’ll likely work with many of them:

• Python
• Go
• PostgreSQL
• Redis
• Docker & Kubernetes
• AWS, GCP, Azure
• FastAPI
• Terraform
• Git Hub Actions
• Open Telemetry
• LLM APIs and inference infrastructure

• Take ownership from idea to production.
• Care about writing clean, maintainable code.
• Think systematically about reliability and scalability.
• Enjoy learning new technologies.
• Move quickly without sacrificing quality.
• Are excited about building products in the AI infrastructure and security space.

• Build foundational infrastructure for the next generation of AI applications.
• Solve challenging distributed systems and infrastructure problems.
• Work directly with experienced engineers from companies like Google, Apple, Microsoft, and leading security organizations.
• High ownership with significant impact from day one.
• Competitive salary and meaningful equity.
• Opportunity to help define the future of enterprise AI security.