Software Engineer III– AI Systems

Reference: R-2445762

Posted:

Location:

BENTONVILLE, AR, United States; BELLEVUE, WA; SUNNYVALE, CASalary: $90000 - $180000/year

Type:
Full time / Regular/Permanent Company:
Walmart Business Segment:
Home Office

Key Responsibilities AI Systems & Agentic Workflows Build agentic AI services (planning, tool use, retrieval, feedback loops) and integrate them with internal systems and APIs. Implement orchestration, memory, tooling, evaluation, and guardrails for agentic workflows. Collaborate with DS/MLE partners to product ionize models (LLMs, GNNs, embedding services) behind stable APIs and SDKs. Accelerated Compute & Data Pipelines Develop GPU‑accelerated pipelines using RAPIDS (cuDF/cuML/cu Graph) and optimize end‑to‑end performance.

Use Ray (or similar) for distributed compute, batch/stream processing, and scalable workflow orchestration. Profile and optimize bottlenecks across CPU/GPU, memory, and I/O layers; implement caching, vectorization, and async patterns. Service & Platform Engineering Design and maintain reliable microservices for training/inference, vector indexing, and real-time decisioning. Implement observability (tracing/metrics/logging), fault tolerance, auto-scaling, and cost-aware execution. Create internal SDKs/CLIs to streamline developer workflows, testing, and reproducibility.

Quality, Security & MLOps Integration Establish CI/CD for AI services (unit/integration/e2e tests, canaries, blue/green, rollback). Integrate with feature stores, vector databases, artifact registries, and model catalogs. Enforce security, privacy, and compliance (data minimization, PII handling, governance, auditability). Collaboration & Influence Partner with product, platform, and DS/MLE teams to align requirements, SLAs, and success metrics. Document systems thoroughly; contribute to design reviews and engineering best practices.

Mentor peers on AI systems patterns, distributed compute, and performance engineering.

Minimum Qualifications Bachelor’s/Master’s in CS, Engineering, or equivalent industry experience. 4+ years building production backend or platform services (preferably in AI/ML contexts). Proficiency in:

Languages:

Python (primary), plus one of Go/Java/C++ for performance services. Distributed frameworks:
Ray, Spark, or Dask. Accelerated compute: RAPIDS (cuDF/cuML/cu Graph) and GPU-aware programming concepts (streams, memory). Service frameworks:
FastAPI/Flask (Python), K8s (Kubernetes) and containerization (Docker). Strong foundations in data structures/algorithms, concurrency, networking, and systems design.

Preferred Qualifications Production experience with agent frameworks (e.g., Lang Graph-style planners, tool-use patterns, retrieval and memory components).

Experience with vector databases (e.g., FAISS, Milvus, pgvector, Pinecone) and feature stores. Familiarity with LLM and embedding services, prompt/tooling patterns, and evaluation harnesses. Hands-on with Kubernetes, autoscaling (HPA/KEDA), and GPU scheduling/operators. Performance profiling:
PyTorch profiler, Nsight, line-profiler, Ray dashboard.

Experience with vLLM, Triton Inference Server, ONNX Runtime, or TensorRT for high‑throughput inference. Soft Skills & Leadership Pragmatic problem solver with a bias for measurable outcomes (latency, throughput, reliability). Excellent communicator able to translate between research goals and production constraints. Drives clarity in ambiguous problem spaces; mentors others and uplifts engineering standards. About Walmart Global Tech Imagine working in an environment where one line of code can make life easier for hundreds of millions of people.

That’s what we do at Walmart Global Tech. We’re a team of software engineers, data scientists, cybersecurity expert's and service…