Sustainment Technical Product Specialist
Listed on 2026-08-09
-
IT/Tech
Cybersecurity, AI Evaluation
Sustainment Technical Product Specialist
K ’s National Security Solutions team provides high‑end engineering and advanced technology solutions to our customers in the intelligence and national security communities. In this position, your work will have a profound impact on the country’s most critical role – protecting our national security.
K (formerly Lin Quest) is the prime contractor on the Military Satellite Communications (MILSATCOM) Systems Engineering, Integration and Test (MSEIT) contract.
K is seeking a highly‑skilled, motivated and proactive teammate to support Mission Delta 8 (MD8), 8th Sustainment Squadron (8
STS) located at Peterson Space Force Base (PSFB), CO. We conduct operations and sustainment (O&S) activities for state‑of‑the‑art Military and Commercial Satellite Communications (SATCOM) and Nuclear Command, Control and Communications (NC3) systems, providing global secure, survivable and protected communications for our Nation’s warfighters.
- Innovative Projects: K ’s work is at the forefront of engineering, logistics, operations, science, program management, mission IT and cybersecurity solutions.
- Collaborative Environment:
Be part of a dynamic team that thrives on collaboration and innovation, fostering a supportive and intellectually stimulating workplace. - Impactful Work:
Your contributions will be pivotal in designing and optimizing defense systems that ensure national security and shape the future of space defense.
- Develop and maintain a practical roadmap for agentic AI and AI/ML evaluation capabilities that can be applied to the MSEIT Sustainment Test and Evaluation effort
- Conduct structured applied learning in AI/ML, LLMs, RAG, agents, evaluation frameworks, tracing, safety, reliability, and related software practices; convert learning into usable artifacts
- Design, build, and maintain evaluation harnesses for LLM‑enabled and agentic AI applications, including golden test sets, rule‑based and model‑based graders, human‑validated scoring approaches, CI‑integrated regression gates, and evidence packages
- Define evaluation claims, measures, acceptance criteria, datasets, rubrics, test conditions, traces, and readiness evidence for AI‑enabled systems
- Evaluate not only what an AI system says, but what it does, how it does it, what authority it exercises, and what happens when it deviates
- Instrument AI systems with distributed tracing and observability practices to support failure diagnosis, drift detection, regression analysis, and black‑box evaluation in constrained environments
- Conduct adversarial and resilience‑oriented assessments of agentic systems, including prompt injection, goal hijacking, tool misuse, memory poisoning, and related failure modes; document findings and mitigation outcomes
- Help distinguish AI‑system failure from test‑case defects, evaluator defects, environment failures, configuration problems, and insufficient evidence
- Translate reproducibility, auditability, evaluation integrity, resilience, operational recovery, safety assurance, and human oversight into testable engineering requirements and practical contract guidance
- Map established T&E practices to AI evaluation and create roadmaps, playbooks, demonstrations, templates, and guidance that help other engineering and test personnel extend their skills into the AI domain
- Identify mission‑relevant AI/ML use cases and provide evidence‑based recommendations concerning value, limitations, risk, readiness, and operational implications
- Produce error taxonomies, technical reports, executive briefings, reference material, and decision‑quality evidence for leadership and engineering stakeholders
- Coordinate with systems engineering, software, cybersecurity, data, product, program, and customer stakeholders to ensure evaluations reflect mission context and operational risk
- Location:
On‑Site Peterson Space Force Base, Product Support Facility (PSF), Bldg. 2025. 1050
E. Stewart Ave., Colorado Springs, CO 80914 - Travel Requirements: less than 20%
- Working Hours:
Standard
- Active DoW Top Secret clearance with SCI eligibility
- Bachelor’s degree in computer science,…
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).