Senior Distinguished Engineer, AI Compute; Remote Eligible

Overview

At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real‑time, personalized customer experiences. Our investments in technology infrastructure and world‑class talent—along with our deep experience in machine learning—position us to be at the forefront of enterprises leveraging AI. From informing customers about unusual charges to answering their questions in real time, our applications of AI & ML bring humanity and simplicity to banking.

The Capital One machine learning platform organization manages our cloud‑based enterprise AI+ML system, delivering the high‑scale developer and runtime environments required to build, orchestrate, and deploy compute‑ and data‑intensive AI systems across real‑time and batch workloads. We are seeking a Senior Distinguished Engineer, a hands‑on technical leader passionate about distributed systems, to engineer and scale foundational compute capabilities for our platform.

• Architect and build control and data plane implementations required to realize a highly available, multi‑tenant, large‑scale and secure machine learning platform.
• Develop Ray and Spark distributed compute engine solutions to accelerate diverse workloads from LLM pre‑training and reinforcement learning to large‑scale data processing, while maximizing compute unit economics.
• Engineer systemic improvements for operational excellence, including automating KTLO (Keep The Lights On) workflows.
• Direct the technical execution of a diverse project portfolio, collaborating with developers specializing in everything ranging from distributed microservices to running large foundation models.
• Work cross‑functionally with product and program management disciplines, and stakeholder partners across Capital One to help optimize business outcomes while driving toward strong technology solutions.
• Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal and external technology communities, and leading system design and code review sessions.
• Help elevate the Capital One Distinguished Engineering community and establish yourself as a go‑to resource on given technologies and technology‑enabled capabilities.
• Lead the way in creating next‑generation talent, mentoring internal talent and actively recruiting external talent to bolster the Capital One tech talent pool.

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 10 years of experience developing AI and ML algorithms or technologies, or a Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 8 years of experience developing AI and ML algorithms or technologies.
• At least 10 years of experience programming with Python, Go, Scala, or Java.

• Master’s Degree in Computer Science or a Master’s Degree in Software Engineering.
• Hands‑on experience in the internals of Ray (Actors/GCS/Scheduling) or Spark (Query Optimizer/Memory Management).
• Experience building platforms that support LLM training, fine‑tuning, or high‑throughput inference.
• Hands‑on experience with AWS‑specific compute primitives (EKS, EC2 Ultra Clusters, Graviton) and cost‑optimization strategies.
• History of upstream contributions to major distributed systems projects.

Capital One will consider sponsoring a new qualified applicant for employment authorization for this position.

Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non‑discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug‑free workplace.