Senior/Lead GCP DevOps Engineer; ML/AI
Listed on 2026-07-19
-
IT/Tech
Cloud Computing: Infrastructure & Operations, SRE/Site Reliability
Location: New York
You'll join a cloud engineering team responsible for designing and operating GCP infrastructure and AI-powered workloads for high-profile, security-conscious clients.
Our client delivers secure, large-scale cloud and AI infrastructure for the enterprise and banking sectors, helping them modernize legacy systems and safely adopt AI/ML technologies.
This is a US-based role (New York City, Jersey City, Lake Mary, FL, or Pittsburgh) with an anticipated base salary range of $144,000–$168,000 annually.
Responsibilities- Design, deploy, and maintain GCP infrastructure, including secure Landing Zones (VPC, IAM, VPC Service Controls, Cloud KMS)
- Lead deployment and operations of AI/ML infrastructure, including GPU-accelerated workloads and LLM inference platforms (NVIDIA NIM, Vertex AI)
- Build and maintain CI/CD pipelines and infrastructure-as-code (Terraform, Jenkins/Git Lab)
- Implement cost optimization strategies across production and non-production environments
- Ensure compliance and security best practices for handling sensitive data in regulated industries
- Mentor engineers and act as a technical point of contact for client engagements
- 5+ years of experience in Dev Ops/Cloud Engineering, with a strong focus on Google Cloud Platform
- Proven experience with Kubernetes, Docker, and container orchestration at scale
- Experience with IAM, network security, and compliance frameworks in regulated industries (banking/finance preferred)
- Familiarity with AI/ML infrastructure and LLM deployment tooling is a strong plus
- GCP Professional certifications (Cloud Architect, Cloud Engineer, Network Engineer) are a plus
Soft Serve is an equal opportunity employer. Qualified applicants will receive consideration regardless of race, color, ancestry, ethnicity, national origin, religion, sex, sexual orientation, gender identity or expression, age, citizenship, disability, health condition, marital or family status, veteran status, or any other characteristic protected by applicable law.
Benefits- Work from home, from the office, or in a hybrid format that supports focus and collaboration.
- Competitive, market-based pay, benchmarked by role and location — plus health coverage, paid time off, wellness support, and learning opportunities.
- Approachable leaders who communicate openly, keep teams close to the strategy, and support long-term planning.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).