Machine Learning Engineer — AI Safety & Assurance

Responsibilities

About the Team

You will join the Tik Tok USDS JV - Data Governance and Assurance Engineering team, the architects of the foundational infrastructure managing the end-to-end AI lifecycle. Our mission is to ensure the integrity, security, and compliance of our AI assets through automated frameworks and advanced content assurance standards. Our team operates at the high-stakes intersection of Tik Tok's State-of-the-Art (SOTA) Recommendation Systems, Adversarial ML, and AI Governance.

We are building the "safety operating system" for Tik Tok’s US data, replacing manual oversight with scalable, automated code that enforces safety and alignment across one of the world's most sophisticated algorithmic ecosystems.

About the Role

As an Machine Learning Engineer - AI Safety at USDS, you will be responsible for the technical "guardrails" and integrity of Tik Tok’s recommendation and General Purpose AI (GPAI) systems. You will build the high-performance engines that audit, evaluate, and mitigate risks in real-time.

• Recommendation & GPAI Assurance:
  Architecting auditable recommendation pipelines to ensure content delivery systems meet strict USDS compliance and safety requirements.
• Algorithmic Interpretability:
  Enhancing the transparency of recommendation signals to ensure model decisions are explainable and aligned with safety protocols.
• Continuous Monitoring & Mitigation:
  Developing automated pipelines to evaluate, monitor, and fine-tune GPAI/LLM deployments to proactively mitigate risks such as bias, toxicity, and misinformation.

• Automated Safety Evaluation:
  Design and scale high-throughput evaluation engines to benchmark LLM and Recommendation Model outputs against safety, bias, and accuracy protocols.
• Adversarial Robustness:
  Build and maintain continuous monitoring frameworks to proactively identify vulnerabilities in recommendation logic and model behavior.
• Governance-as-Code:
  Architect metadata frameworks and control planes for ML pipelines, ensuring training data and model weights adhere to purpose-limitation and safety constraints.
• Real-time Mitigation:
  Develop low-latency safety filters and "circuit breakers" that can intervene in real-time recommendation streams (ms-level latency) without compromising system performance.
• Observability & Lineage:
  Create centralized platforms that provide real-time observability into model decisions, ensuring every algorithmic "promotion" is traceable, auditable, and compliant.

Minimum Qualifications:

• Education:
  
  Bachelor’s or Master’s degree in Computer Science, Machine Learning, or a related technical field.
• Software Engineering: 2+ years of experience in production-level software development (Go, Python, or C++).
• Systems at Scale:
  Proven experience with Distributed Systems and handling high-volume ML data pipelines (e.g., Spark, Flink, or Kafka).
• ML Foundations:
  Strong grasp of Data Structures, Algorithms, and Machine Learning fundamentals (Deep Learning, Optimization, Evaluation Metrics).

Preferred Qualifications:

• AI Safety Expertise:
  Direct experience in AI Alignment, Model Interpretability (XAI), or Adversarial Machine Learning.
• LLM Specialization:
  Familiarity with LLM evaluation frameworks (e.g., G-Eval, RAGAS), safety fine-tuning (RLHF/DPO), or prompt-injection defense.
• Rec Sys Knowledge:
  Deep understanding of modern content recommendation systems (e.g., Two-tower models, Deep Ranking, Reinforcement Learning).
• Full-Stack ML Tech:
  Proficiency in Go (Golang) for high-performance backend infrastructure and Python/PyTorch for ML modeling and research.
• Regulatory Translation: A proven ability to translate complex legal and safety policies into rigorous, scalable technical implementations.

Tik Tok USDS…