Software Engineer II - AI Infrastructure

Job d:

Location:

United States, California, Mountain View Salary: USD $102,100 - $202,200 per year

Employment type:

Full-Time Work site: 3 days / week in-office

Role type:
Individual Contributor Travel:
Less than 25%
Profession:
Software Engineering Discipline:
Software Engineering Company:
Microsoft Overview Software  engineer role in Cloud + AI team, enabling secure, scalable, and high-performance AI experiences across multimodal verticals, including real-time audio interaction, image generation, video generation and AI safety systems.

You will contribute across the full technology stack, from APIs and platform services to the inference infrastructure serving cutting-edge AI models at massive scale. You'll work on systems that power real-world products used by millions of customers while helping advance the reliability, safety, and efficiency of AI platforms.

This role is based in either Mountain View, CA or Redmond, WA. We are looking for engineers who thrive in fast-paced environments, enjoy tackling complex technical challenges, and excel in collaborative teams.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities Implement AI Systems:
Design and build scalable, reliable architectures that meet high-performance requirements for AI systems including inference backends and API interfaces. Apply knowledge of distributed systems principles to create robust solutions.

Debug and Optimize Across the Stack: dive deep into existing components to identify and resolve issues quickly. Ensure fast turnaround for critical fixes while maintaining system integrity.

Collaborate Across Teams and Partners: work closely with multiple internal teams and external partners to solve complex problems, align on technical decisions, and deliver integrated solutions.

Innovate and Drive Technical Excellence: identify non-obvious technical approaches that unlock new possibilities. Architect and execute features with measurable goals, iterating rapidly to achieve outcomes.

Full-Stack Engagement: engage with components across the entire stack—from infrastructure to APIs—to deliver end-to-end solutions.

Qualifications

Required Qualifications:

Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or PythonOR equivalent experience.

Preferred Qualifications:

Master's Degree in Computer Science or related technical fieldAND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or PythonOR Bachelor's Degree in Computer Science or related technical fieldAND 5+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or PythonOR equivalent experience.

Core technical competencies: distributed systems, scalable architecture, API design, understanding of ML/AI fundamentals and practical applications, experience in delivering AI-based solutions.

Familiarity with relevant tools, frameworks, or programming languages:
Kubernetes, Azure Devops, Docker, AI / ML frameworks, Python, C++, C#, Rust, gRPC, FastAPI, Autogen, Semantic Kernel, Lang Chain.

Optional experience with OpenAI API / Azure OpenAI.Communication and collaboration abilities.

Problem-solving and decision-making under ambiguity.

Strategic thinking and adaptability.

Softw…