Software Engineer, AI Engineer (Applied​/Software), Cloud Engineer - Software

1345 Crossman Ave, Sunnyvale, CA
Job : R-2327106
Salary: $143,000 - $286,000/yr
Type:
Regular / Permanent

Building the right technology foundation for Infrastructure & Platforms is vital to success at the scale of Walmart. Our team builds and maintains the foundational technologies that support the tech organization. Included in this are data platforms, enterprise architecture, Dev Ops, cloud computing, and infrastructure. All of these products and services are supported by scalable and powerful infrastructure, ensuring a secure and seamless employee and customer experience across stores, digital channels, and distribution centers.

Walmart Global Tech is at the forefront of AI innovation, leveraging cutting‑edge technologies to redefine customer experiences. We are seeking a Staff Software Engineer with deep expertise in Generative AI, LLMs, Agentic and RAG frameworks to lead the design, development and deployment of advanced AI systems. This role involves architecting scalable solutions, integrating agentic frameworks and mentoring engineering teams to push the boundaries of AI‑driven innovation.

In this role you will work closely with Engineering teams, Architects and Product groups to provide highly recommended Developer Experience and Gen AI solutions that delight developers.

• Design, develop, fine‑tune, and deploy Generative AI models with a focus on RAG frameworks to enhance information retrieval and generation.
• Develop and optimize LLM‑based agents for tasks such as knowledge grounding, multi‑step reasoning, and decision‑making.
• Integrate external data sources (e.g., vector databases) with LLMs to build dynamic, context‑aware systems.

• Design scalable, distributed AI systems with a focus on performance, fault tolerance and disaster recovery.
• Develop detailed design specifications, including modular, extensible and functional components.
• Transform MVPs into shippable products to validate requirements and continuously refine designs.
• Leverage containerization (Docker), CI/CD pipelines and deployment best practices.

• Work cross‑functionally to design solutions meeting both functional and non‑functional requirements.
• Establish best practices for building and maintaining AI‑driven systems.
• Drive technical direction for large‑scale AI initiatives and mentor junior engineers.
• Build tech stacks from the ground up and deploy scalable solutions.

• 8+ years of experience in machine learning / software engineering, including 2+ years in Generative AI or LLMs.
• Strong experience with Agentic Frameworks, RAG frameworks, vector search technologies and knowledge grounding techniques.
• Expertise in Python, ML frameworks (PyTorch, Tensor Flow) and libraries such as Hugging Face Transformers.
• Clear communication skills and ability to bridge design gaps.
• Capacity to multitask across multiple requirements and features concurrently.
• Proficiency in distributed computing and cloud platforms (GCP, Azure) with scalable architectures.
• Deep knowledge of open‑source projects or publications in Generative AI, RAG or agentic frameworks.
• Experience working in a team environment and passion for technology.
• Strong backend programming experience in Python, Go, Java or Type Script.

• Experience with Gen AI – Agentic Frameworks, RAG Frameworks.
• Cloud architecture and deployments:
  Kubernetes, Docker, micro‑services (REST).

• Competitive compensation package with annual or quarterly performance bonuses.
• 401(k) matching and stock purchase plan.
• Paid maternity and parental leave, paid time off (PTO), sick leave, family care leave, bereavement, jury duty, and voting leave.
• Health, vision, dental and wellness programs.
• Short‑term and long‑term disability and life insurance.
• Company discounts, military leave pay and adoption or surrogacy expense reimbursement.
• Live Better U educational program – 100 % tuition and book coverage for eligible courses.

Walmart, Inc. is an Equal Opportunity Employer – By Choice. We believe we are best equipped to help our associates, customers, and the…