Senior Software Engineer, AI Operations, GPS

Senior Software Engineer, AI Operations, GPSRole Overview

As a Senior Software Engineer, AI Ops at Scale AI, you will own the long-term technical health, performance, and stability of AI solutions deployed across our strategic public sector partners.

While our Delivery Teams build and launch new use cases, you are the technical steward ensuring these deployments operate with Operational Excellence. You will bridge software engineering, MLOps, and client governance, managing tiered SLAs, tracking model drift, and executing maintenance protocols that protect both system integrity and operational margins.

• Handover Gate & Onboarding:
  Act as the technical gatekeeper during the formal transition from Delivery to Maintenance. Conduct deep-dive reviews to ensure baseline code, prompts, and architecture meet strict maintainability and documentation standards before sign-off.
• Tiered SLA & Incident Management:
  Own technical response and resolution targets across multi-tiered service models (from Business-Hours Essential to 24/7 Mission-Critical). Lead Incident Governance, Root Cause Analysis (RCA), and P1/P2 mitigations within strict active support windows.
• AI Lifecycle Governance:
  Monitor production model performance, latency, and data drift. Manage prompt configuration repositories to maintain behavioral consistency and perform regression testing when LLM providers update underlying endpoints.
• Request Classification & Technical Scope:
  Operationalize the boundary between Routine Maintenance (In-Scope) and System Evolution (Out-of-Scope). Assess incoming client requests and run comparative benchmarking on new AI models.
• Automation & Reliability Engineering:
  Eliminate operational toil by engineering self-healing data pipelines, automated RAG indexing syncs, and telemetry tooling. Influence upstream 'Delivery' teams to adopt architectural patterns that simplify ongoing maintenance.
• Client Technical Interface:
  Serve as the senior technical point of contact for government and enterprise IT leads. Translate technical AI concepts (data drift, prompt versioning, API deprecation) into clear business impacts for non-technical stakeholders.

• Background: 5+ years in Software Engineering, MLOps, SRE, or Forward Deployed Engineering in heavy data or production AI environments.
• Technical Stack:
  Advanced proficiency in Python, SQL, REST/gRPC APIs, and cloud architecture (AWS, Azure, or GCP). Hands-on experience with MLOps tooling, vector databases, and LLM orchestration frameworks (e.g., Lang Chain, Llama Index).
• AI Governance Expertise:
  Practical understanding of prompt version control, model benchmarking against evaluation datasets, RAG pipeline mechanics, and data drift detection.
• Engineering Mindset: A drive to build systematic, automated fixes rather than applying temporary patches. Strong grasp of CI/CD for machine learning pipelines.
• Client Acumen & Boundary Control:
  Strong technical communication skills with the ability to manage client expectations, defend operational boundaries (Maintenance vs. Evolution), and advise on long-term system roadmaps.

About Us:

At Scale, our mission is to develop reliable AI systems for the world's most important decisions. Our products provide the high-quality data and full-stack technologies that power the world's leading models, and help enterprises and governments build, deploy, and oversee AI applications that deliver real impact. We work closely with industry leaders like Meta, Ernst & Young, Mayo Clinic, Time Inc.,

the Government of Qatar, and U.S. government agencies including the Army and Air Force. We are expanding our team to accelerate the development of AI applications.

We believe that everyone should be able to bring their whole selves to work, which is why we are proud to be an inclusive and equal opportunity workplace. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability status, gender identity or Veteran status.

We are committed to working with and providing reasonable accommodations to applicants with physical…