Senior AI​/ML Software Engineer

Job Description

Design and build AI-enabled backend services and APIs using Java and Python

Integrate machine learning and GenAI models into production software systems

Develop services that support model inference, orchestration, and business workflows

Collaborate with data scientists to product ionize models built with Tensor Flow, PyTorch, Hugging Face, or similar frameworks

Implement scalable, fault-tolerant microservices that consume and expose AI/ML capabilities

Deploy and run applications on Open Stack-hosted environments without owning underlying infrastructure

Work within containerized environments (Docker/Kubernetes) from an application perspective

Apply software engineering best practices around API design, performance, testing, and observability

Participate in architecture and design discussions for AI-driven systems

Troubleshoot and optimize application-level performance tied to data volume, model latency, and throughput

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances.

If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to  learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy:

6-9+ years of software engineering experience

Strong background as a Java or Python backend developer

Expert-level experience with Java, Spring Boot, REST APIs, and microservices

Hands-on experience transitioning into AI/ML application development (libraries like Facebook profit and anomaly detection)

Experience integrating ML models into real production applications

Working experience deploying applications on Open Stack-based private cloud or similar enterprise platforms

Experience developing applications that run on Docker and Kubernetes (no platform ownership required)

Solid understanding of distributed systems, scalability, and service reliability Experience with GenAI or LLM-based applications

Familiarity with MLOps concepts (model versioning, deployment patterns, monitoring)

Experience bridging Python-based ML workflows with Java services

Exposure to event-driven or data-intensive systems

Background in large enterprise environments with complex application ecosystems

Ansible, Terraform

Azure cloud

Prior Walmart Experience