Principal, Software Engineer – GenAI Initiative

Principal, Software Engineer – GenAI Initiative

Walmart Global Tech is at the forefront of AI innovation, leveraging cutting‑edge technologies to redefine customer experiences. We are seeking a Principal, Software Engineer with deep expertise in Generative AI, LLMs, and RAG frameworks to lead the design, development, and deployment of advanced AI systems. This role involves architecting scalable solutions, integrating agentic frameworks, and mentoring engineering teams to push the boundaries of AI‑driven innovation.

As part of Walmart’s Global Sourcing Backend team, you will be building highly scalable and reliable APIs, services and applications which will drive the next generation purchase order management system. You’ll independently handle high impact, critical software/systems monitoring issues, troubleshoot business and production issues. As a member of this fast‑moving and highly entrepreneurial team, you’ll be able to say that you work for the world’s largest retailer and contribute to innovation and development to best‑in‑class methodologies that impacted perception and drastically changed business as we know it.

Focusing on customer, associate and business needs, this team works with Walmart International, which includes more than 5,200 retail units, operating in 23 countries such as Canada, Central America, Chile, China, India, Mexico and South Africa to name a few.

• Design, fine‑tune, and deploy Generative AI models with a focus on RAG frameworks to enhance information retrieval and generation.
• Develop and optimize LLM‑based agents for tasks like knowledge grounding, multi‑step reasoning, and decision‑making.
• Integrate external data sources (e.g., vector databases) with LLMs to build dynamic, context‑aware systems.
• Architect scalable, distributed AI systems with a focus on performance, fault tolerance, and disaster recovery.
• Develop detailed design specifications, including modular, extensible, and functional components.
• Build MVPs to validate requirements and refine designs iteratively.
• Partner with product teams to integrate AI into customer‑facing applications.
• Work cross‑functionally to design solutions that address both functional and non‑functional requirements.
• Drive technical direction for large‑scale AI initiatives and mentor junior engineers.
• Establish best practices for building and maintaining AI‑driven systems.

• Overall 12+ years of experience in machine learning / software engineering, with 2+ years in Generative AI or LLMs.
• Strong experience with RAG frameworks, vector search technologies and knowledge grounding techniques.
• Expertise in Python, ML frameworks (PyTorch, Tensor Flow), and libraries like Hugging Face Transformers.
• Proficiency in distributed computing, cloud platforms (GCP, Azure), and scalable architectures.
• Familiarity with disaster recovery principles and building resilient, fault‑tolerant systems.
• Experience with multi‑modal models (text, image, video) and advanced optimization techniques (e.g., quantization, distillation).
• Experience with Generative AI models (e.g., GPT, Gemini) and their fine‑tuning.
• Contributions to open‑source projects or publications in Generative AI, RAG, or agentic frameworks.
• Strong understanding of system design, non‑functional requirements, and design patterns.

At Walmart, we offer competitive pay as well as performance‑based bonus awards and other great benefits for a happier mind, body, and wallet. Health benefits include medical, vision and dental coverage. Financial benefits include 401(k), stock purchase and company‑paid life insurance. Paid time off benefits include PTO (including sick leave), parental leave, family care leave, bereavement, jury duty, and voting. Other benefits include short‑term and long‑term disability, company discounts, Military Leave Pay, adoption and surrogacy expense reimbursement, and more.

You will also receive PTO and/or PPTO that can be used for vacation, sick leave, holidays, or other purposes. The amount you receive depends on your job classification and length of employment. It will meet or exceed the…