Senior Engineering Manager - Akamai Inference Cloud; Remote
Cambridge, Middlesex County, Massachusetts, 02140, USA
Listed on 2025-12-27
-
IT/Tech
AI Engineer, Systems Engineer
Senior Engineering Manager - Akamai Inference Cloud (Remote)
Akaam’s Inference Cloud team operates at the intersection of AI and edge computing, designing, deploying, and running AI platforms that enable customers to run inference models and developers to create AI applications with unmatched performance, compliance, and economics.
Key Responsibilities- Build and scale a world‑class engineering team from the ground up, recruiting top talent in AI infrastructure, ML operations, and platform engineering.
- Lead the technical strategy for a global AI inference platform that is performant, compliant, economical, and explainable.
- Ensure the availability, performance, scalability, and security of Akamai Inference Cloud.
- Design global traffic orchestration for AI workloads and establish platform standards and blueprints for production‑grade AI applications.
- Make critical decisions on AI tooling based on technical evaluation while ensuring compliance with regulatory requirements (FedRAMP, GDPR, SOX).
- 10+ years of experience building and scaling high‑performing teams that shipped successful AI/ML products;
Bachelor’s degree or equivalent. - Hands‑on experience with AI inference optimization, model serving, and LLM deployment at scale; deep knowledge of inference frameworks (Tensor
RT, vLLM, Torch Serve, Triton). - Understanding of containerization strategies for AI workloads with hardware‑specific optimizations; strong opinions on what makes an AI platform successful.
- Proficiency with cloud‑native technologies including Kubernetes and distributed systems, with proven experience operating services at global scale.
- Expertise in building highly available, low‑latency platforms with strict SLOs and cost‑optimization strategies for compute‑intensive AI workloads.
- Knowledge of AI application platforms, AI safety, GPU infrastructure, and hardware acceleration is ideal.
- Flex Base: 95% of employees choose to work from home, office, or both (in the country advertised).
- Health, finances, family, time at work, and time pursuing other endeavors.
For US‑based candidates only: base salary ranges from $155,600 – $323,200 per year. Salary is determined by experience, skills, certifications, and location. Compensation may also include incentive compensation (annual bonus or incentives), equity awards, and an Employee Stock Purchase Plan (ESPP). Eligible candidates receive industry‑leading benefits including healthcare, 401K, company holidays, vacation (PTO), sick time, parental leave, and employee assistance programs focused on mental and financial wellness.
EEOStatement
Akamai Technologies is an affirmative action, equal opportunity employer that values the strength that diversity brings to the workplace. All qualified applicants will receive consideration for employment and will not be discriminated against on the basis of gender, gender identity, sexual orientation, race/ethnicity, protected veteran status, disability, or other protected group status.
Work RemotelyJobs are open on an ongoing basis until the position is filled.
#J-18808-Ljbffr(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).