Software Development Engineer - Agentic AI/ML Infrastructure
California, USA
Listed on 2026-10-19
-
Software Development
AI Engineer (Applied/Software), Machine Learning/ ML Engineer
Our client is seeking a Software Development Engineer to join their team. As a Software Development Engineer, you will be part of a senior individual contributor effort supporting agentic AI / ML infrastructure work across the software stack. The ideal candidate will have a strong drive to deliver production-grade Python systems, the ability to debug distributed GPU workloads with evidence-based analysis, and the confidence to own complex components end-to-end while collaborating with technical leads and partner teams.
Job Title:
Software Development Engineer - AI / ML
Location:
California, CA (Remote)
Pay Range: $90
Visa sponsorship not available
What's the Job?Architect and implement Python agent frameworks, including tool adapters, orchestration loops, structured outputs, session handling, and production-ready CLI or service interfaces. Build LLM-powered workflows using frameworks such as LiteLLM, DSPy, or equivalent, with bounded prompts, allow listed tools, budget caps, structured JSON outputs, and evidence-backed reporting. Integrate agents with the AMD GPU and ML software ecosystem, including ROCm tooling, PyTorch, distributed training and inference stacks, profilers, cluster metrics, log pipelines, and debug utilities.
Own quality and evaluation infrastructure, including fixture-driven tests, JSON Schema validation, regression suites, accuracy metrics, and CI integration prior to rollout. Solve ML operations challenges on training and inference clusters, including multi-node failure analysis, performance regression investigation, configuration and launch issues, and operational automation.
- Bachelor's degree or higher in Computer Science, Computer Engineering, Electrical Engineering, or a related field; equivalent practical experience accepted.
- 10+ years of professional software engineering experience, including 5+ years developing production Python systems at scale.
- Deep experience with distributed ML training or inference on GPU clusters, including multi-node jobs, collective communication failures, and log/metric correlation across ranks and nodes.
- Strong hands-on experience with PyTorch and production familiarity with large-scale stacks such as Megatron-LM, Deep Speed, Torch Titan, vLLM, or equivalent.
- Proven ML debugging and performance engineering experience across throughput regressions, memory errors, numerical instability, misconfiguration, and profiler/trace analysis.
- Opportunity to build production-grade intelligent agents that reduce manual toil in ML operations.
- Senior ownership of end-to-end components, from design and implementation to evaluation and rollout readiness.
- Hands-on impact across training and inference clusters, including distributed failure investigation and performance regression work.
- Collaboration with framework, performance, and field teams to incorporate feedback and iterate based on production and pilot learnings.
- Clear delivery expectations, including deployment-ready artifacts such as Docker/Kubernetes packaging, runbooks, and documentation.
Upon completion of waiting period consultants are eligible for:
- Medical and Prescription Drug Plans
- Dental Plan
- Vision Plan
- Health Savings Account
- Health Flexible Spending Account
- Dependent Care Flexible Spending Account
- Supplemental Life Insurance
- Short Term and Long Term Disability Insurance
- Business Travel Insurance
- 401(k), Plus Match
- Weekly Pay
About Manpower Group, Parent Company of:
Manpower, Experis, Talent Solutions, and Jefferson Wells. Manpower Group® (NYSE: MAN), the leading global workforce solutions company, helps organizations transform in a fast-changing world of work by sourcing, assessing, developing, and managing the talent that enables them to win. We…
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).