Principal Software Engineer – Machine Learning Infrastructure

Responsibilities

• Oversee technical strategy and architecture in ML Inference Platform services
• Design, implement, and scale critical engineering components and services to support ML inference and deployment
• Work across teams to understand product requirements, evaluate trade-offs, and deliver the solutions needed to build innovative products or services
• Advocate for and apply best practices when it comes to availability, scalability, operational excellence, and cost management
• Provide technical direction that influences the entire company

• Bachelors in technical field such as computer science, mathematics, statistics or equivalent years of experience
• 10+ years of post-Bachelor’s software development experience; or a Master’s degree in a technical field + 9+ year of post-grad software development experience; or a PhD in a related technical field + 6+ years of post-grad software development experience
• 2+ years of experience with technical leadership or acting as the domain‑expert to a technical organization
• Experience in technical leadership/ownership and setting technical direction for engineering projects
• Experience architecting, designing, and developing large scale distributed systems and high-throughput RPC services
• Experience with Tensorflow, PyTorch, Kubernetes, GPU, LLM inference is a plus

Demonstrates expertise in overseeing technical strategy and architecture for ML Inference Platform services, with a strong focus on designing and scaling engineering components. Proven ability to provide technical direction and advocate for best practices in operational excellence and cost management.