×
Register Here to Apply for Jobs or Post Jobs. X

AI Infrastructure Engineer

Job in San Jose, Santa Clara County, California, 95199, USA
Listing for: Socket.dev
Full Time position
Listed on 2026-08-08
Job specializations:
  • IT/Tech
    Cloud Computing: Infrastructure & Operations, Systems Engineer, AI Engineer (Applied/Software)
Salary/Wage Range or Industry Benchmark: 45000 - 121000 USD Yearly USD 45000.00 121000.00 YEAR
Job Description & How to Apply Below

Job Title: AI Infrastructure Engineer

City: San Jose

State/Province: California

Posting

Start Date:

7/9/26

Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients’ most complex digital transformation needs. Leveraging our holistic portfolio of capabilities in consulting, design, engineering, and operations, we help clients realize their boldest ambitions and build future-ready, sustainable businesses. With over 230,000 employees and business partners across 65 countries, we deliver on the promise of helping our customers, colleagues, and communities thrive in an ever-changing world.

For additional information, visit us at

Job Description:

Role

Description:

Architect and build custom Artificial Intelligence (AI) infrastructure solutions leveraging the client Kubernetes Platform and AI. You will be responsible for designing high-performance computational stacks that integrate AI, high-speed software-defined storage, and GPU-accelerated nodes. Your mission is to make AI infrastructure "invisible" by optimizing for performance, power consumption, and seamless hybrid-multicloud scalability across on-prem.

Summary

As an AI Infrastructure Engineer, you will design tailored AI solutions that bridge the gap between private data centers and public cloud. Your day-to-day will involve optimizing the client computational stack for large language models (LLMs) and generative AI workloads. You will serve as the SME for AI, ensuring that compute, storage (client Objects/Files), and networking (Flow) are perfectly tuned for AI model training and inference.

Responsibilities

  • Hybrid Multicloud Architecture:
    Design seamless AI workflows using NC2 on Prem, allowing for rapid bursting of AI workloads from on-prem AHV clusters to the public cloud.
  • Data Services for AI:
    Architect high-performance storage backends using Objects (S3-compatible) to handle the massive datasets required for AI/ML.
  • Kubernetes & Orchestration:
    Deploy and manage AI workloads using client Kubernetes Platform to ensure containerized AI models are scalable and resilient.
  • Infrastructure-as-Code:
    Implement IaC using Calm or Terraform to automate the lifecycle of GPU-enabled nodes.
  • Observability:
    Design frameworks (monitoring, logging, alerting) for proactive issue detection. Hands on experience on Prometheus, Grafana, ELK, and Open Telemetry.
  • Ensure high availability, disaster recovery, and fault tolerance across all systems.
  • Networking & Security:
    Familiarity with Zero-Trust architectures, enterprise networking, storage, and virtualization.
  • Invisible Infrastructure:
    Modernize legacy 3-tier AI silos into a unified, web-scale environment.

Professional & Technical Skills

  • Core: Deep proficiency in AOS (Acropolis Operating System) and AHV (Native Hypervisor).
  • AI Performance: Experience with GPU Passthrough and vGPU configurations to optimize AI training performance.
  • Security: Applying work Flow for micro segmentation to secure sensitive AI training data.
  • Cost Management: Using Cloud Manager (NCM) Cost Governance to monitor and optimize spend across hybrid environments.
  • Mandatory

    Skills:

    GenAI for Internet Software Products.
  • Experience: 3-5 Years.

The expected compensation for this role ranges from $45,000 to $121,000.

Final compensation will depend on various factors, including your geographical location, minimum wage obligations, skills, and relevant experience. Based on the position, the role is also eligible for Wipro's standard benefits including a full range of medical and dental benefits options, disability insurance, paid time off (inclusive of sick leave), other paid and unpaid leave options.

Applicants are advised that employment in some roles may be conditioned on successful completion of a post-offer drug screening, subject to applicable state law.

Wipro provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. Applications from veterans and people with disabilities are explicitly welcome.

Reinvent your world. We are building a modern Wipro. We are an end-to-end digital transformation partner with the boldest ambitions. To realize them, we need people inspired by reinvention. Of yourself, your career, and your skills. We want to see the constant evolution of our business and our industry. It has always been in our DNA - as the world around us changes, so do we.

Join a business powered by purpose and a place that empowers you to design your own reinvention.

#J-18808-Ljbffr
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
 
 
 
Search for further Jobs Here:
(Try combinations for better Results! Or enter less keywords for broader Results)
Location
Increase/decrease your Search Radius (miles)
0
200
Filters
Education Level
Experience Level (years)
Posted in last:
Salary