×
Register Here to Apply for Jobs or Post Jobs. X

Infrastructure Engineer Lead – Cloud AI

Job in Gahanna, Franklin County, Ohio, USA
Listing for: AEP
Full Time position
Listed on 2026-10-16
Job specializations:
  • IT/Tech
    Cloud Computing: Infrastructure & Operations, Systems Engineer, Cybersecurity, SRE/Site Reliability
Salary/Wage Range or Industry Benchmark: 137000 - 178000 USD Yearly USD 137000.00 178000.00 YEAR
Job Description & How to Apply Below
Job Summary

This hands-on role builds and operates secure, scalable infrastructure for AI and machine learning workloads across AWS and approved on-premises environments. Responsibilities include cloud foundations, networking, containers, compute, identity, cost management, and observability.

The engineer partners with AI, architecture, cybersecurity, network, and application teams to deliver secure, cost-effective, production-ready infrastructure while supporting core cloud engineering services.

Job Description

What you’ll do:

Essential Job Functions & Tasks AI Cloud Foundations
  • Design, build and maintain the AWS account structure, landing zones, and reference patterns that host AI and machine learning workloads, leveraging AWS Control Tower, Landing Zone Accelerator, and Terraform.
  • Engineer the compute, storage, and networking foundations required for AI workloads, including GPU and accelerated instance families, high-throughput storage, and data access paths to enterprise data platforms.
  • Enable and operate AI platform services such as Amazon Bedrock and Sage Maker, including private connectivity, model access provisioning, logging, and quota management.
  • Build reusable infrastructure-as-code modules, templates and pipelines so that AI teams can deploy quickly within approved guardrails.
  • Design, build and maintain on-premises AI infrastructure for edge and specialized use cases.

Support AI in disconnected or intermittently connected environments, including local compute, model distribution, patching, monitoring, backup, and recovery.

Create deployment standards, automation, runbooks, and support processes for on-premises and edge AI.

Integrate on-premises AI with enterprise identity, security, networking, monitoring, and governance where feasible.

Controls, Security & Governance
  • Partner with Cybersecurity, Enterprise Architecture and Compliance to align AI infrastructure with AEP security standards, regulatory obligations, and responsible AI guardrails.
  • Review and remediate configuration drift, vulnerabilities and audit findings across the AI cloud estate; support evidence requests and control attestations.
  • Contribute to onboarding and intake processes for new AI use cases, ensuring workloads are provisioned into the right accounts with the right controls from day one.
Fin Ops & Cost Management
  • Establish and operate Fin Ops practices for AI workloads, including tagging standards, showback/chargeback, budgets, anomaly detection, and forecasting.
  • Analyze and optimize spend on GPU compute, inference and token consumption, storage, and data transfer; recommend commitment strategies such as Savings Plans and Reserved Instances.
  • Provide cost transparency and consumption reporting to business stakeholders and technology leadership, and identify optimization opportunities before they become budget issues.
Monitoring & Observability
  • Partner with monitoring team to create logging, alerting and dashboards for AI infrastructure and workloads.
  • Define service-level objectives and operational thresholds for AI platforms, including model endpoint availability, latency, throughput, and error rates.
  • Support incident response, root cause analysis and problem management for AI-related infrastructure events; drive preventive actions and automation to reduce recurrence.
Core Cloud Engineering & Platform Services
  • Perform standard cloud engineering functions across the AEP AWS environment including account provisioning, environment builds, platform upgrades, patching, automation and lifecycle management.
  • Design, deploy and operate Kubernetes environments (Amazon EKS, ROSA/Open Shift) including cluster architecture, autoscaling, node group and GPU scheduling, ingress, service mesh, RBAC, and cluster security hardening.
  • Engineer…
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
 
 
 
Search for further Jobs Here:
(Try combinations for better Results! Or enter less keywords for broader Results)
Location
Increase/decrease your Search Radius (miles)
0
200
Filters
Education Level
Experience Level (years)
Posted in last:
Salary