Senior Principal AI Systems Engineer
Job in
Oregon, Dane County, Wisconsin, 53575, USA
Listed on 2026-08-30
Listing for:
Advantest
Full Time
position Listed on 2026-08-30
Job specializations:
-
Software Development
AI Engineer (Applied/Software), Machine Learning/ ML Engineer
Job Description & How to Apply Below
Advantest is seeking a highly experienced Senior Principal AI Systems Engineer to architect and deliver advanced production AI capabilities. This role is for a hands‑on technical leader with deep expertise in agentic AI, open‑source model development, model fine‑tuning, evaluation systems, and reliable AI infrastructure. The ideal candidate combines advanced AI knowledge with strong software‑engineering discipline and has experience building systems that reason across multiple steps, use tools, evaluate results, recover from failures, and improve from feedback.
Key Responsibilities Agentic AI Systems- Architect production‑grade systems for tool‑using and multi‑step AI agents.
- Design orchestration, planning, memory, session management, retries, timeouts, observability, and failure recovery.
- Establish structured and typed interfaces between models, tools, data services, and applications.
- Build controls that prevent agents from bypassing required validation and approval stages.
- Develop reusable agent frameworks that support multiple products and deployment environments.
- Fine‑tune open‑source language models and specialized models for complex technical applications.
- Apply LoRA, QLoRA, full fine‑tuning, distillation, preference optimization, and related post‑training methods.
- Develop efficient strategies for adapting foundation models to new applications and datasets.
- Evaluate tradeoffs among model quality, inference performance, deployment cost, security, and maintainability.
- Build optimized models and inference profiles for constrained deployment environments.
- Define measurable standards for model accuracy, reliability, safety, and production readiness.
- Build offline evaluation datasets, automated regression suites, judge systems, and promotion gates.
- Develop methods for measuring confidence, consistency, tool‑use accuracy, and action quality.
- Establish processes for model comparison, controlled release, rollback, and continuous improvement.
- Ensure model outputs remain grounded in available evidence and approved data sources.
- Design reproducible pipelines for training‑data generation, cleaning, labeling, versioning, and validation.
- Develop synthetic‑data and preference‑data strategies where appropriate.
- Implement controls for data leakage, contamination, duplication, provenance, and customer isolation.
- Convert expert feedback and observed outcomes into high‑quality training and evaluation datasets.
- Maintain traceability between datasets, experiments, model versions, and production results.
- Build repeatable training, evaluation, and deployment workflows for multi‑GPU infrastructure.
- Establish model lifecycle practices, including model cards, release criteria, monitoring, and rollback.
- Support secure, private, air‑gapped, and customer‑controlled deployment environments.
- Develop observability for model behavior, tool execution, latency, cost, and failure conditions.
- Partner with platform and CI/CD teams to make AI workflows repeatable, testable, and auditable.
- Set technical direction for a small, highly skilled AI engineering team.
- Review architectures, models, training methods, and production implementation decisions.
- Mentor engineers and establish durable AI engineering practices.
- Work with domain experts to translate complex technical requirements into reliable AI capabilities.
- Communicate technical risks, tradeoffs, progress, and recommendations to engineering and executive stakeholders.
Position Requirements
10+ Years
work experience
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×