More jobs:
Ai Platform Engineers; Ai/Genai | Cloud | Kubernetes Onsite
Job in
Sandton, 2172, South Africa
Listed on 2026-10-10
Listing for:
Datafin It Recruitment
Contract
position Listed on 2026-10-10
Job specializations:
-
IT/Tech
AI Engineer (Applied/Software), SRE/Site Reliability, Cloud Computing: Infrastructure & Operations
Job Description & How to Apply Below
ENVIRONMENT:
Our client is seeking highly specialised AI Platform Engineers to design, build, operate and optimise enterprise-grade AI infrastructure within a complex, regulated environment. This is not a general cloud engineering, IT infrastructure or data science role. The successful candidates must have hands-on experience supporting production AI workloads across multi-cloud environments and must be comfortable working across AI infrastructure, model serving, agentic AI, security, observability, infrastructure-as-code and AI cost governance.
DUTIES:- Design, deploy and optimise scalable multi-cloud AI platform infrastructure.
- Build reusable platform components for AI gateways, model serving, vector databases, data pipelines and GPU workloads.
- Develop and maintain infrastructure-as-code using Terraform, Pulumi, Cloud Formation or equivalent technologies.
- Design infrastructure supporting agentic AI, including orchestration environments, tool-calling, agent memory, state management and multi-agent communication.
- Implement cloud-agnostic model-serving patterns that support workload portability.
- Define and manage AI platform SLAs covering availability, inference latency, throughput and reliability.
- Implement platform observability, monitoring, incident management, release management and operational runbooks.
- Design and implement zero-trust security controls for AI platforms.
- Manage AI compute expenditure through cost attribution, chargeback/showback, workload optimisation and usage reporting.
- Maintain technical documentation, architectural decision records and governance evidence.
- Mentor engineers and contribute to platform engineering standards and delivery practices.
- Senior level: approximately 5–8 years of relevant cloud and AI platform engineering experience.
- Lead/Principal level: approximately 8–12 years of relevant experience, including technical leadership and responsibility for engineering teams or platform squads.
Experience:
- Candidates must demonstrate meaningful production experience in most of the following:
- At least two of the following:
- AWS Bedrock or Sage Maker
- Microsoft Azure AI Foundry or Azure OpenAI
- Databricks AI
- Enterprise Hugging Face deployments
- Kubernetes, Docker, Helm and containerised platform services.
- Terraform, Pulumi, AWS CDK, Cloud Formation or equivalent infrastructure-as-code.
- CI/CD and automated deployment of cloud or AI platform components.
- Production model-serving infrastructure, AI gateways or inference endpoints.
- Platform observability using tools such as Prometheus, Grafana, Datadog, Open Telemetry or Databricks Lakehouse Monitoring.
- Cloud security, identity and access management, including OAuth/OIDC, JWT, RBAC or ABAC.
- Production incident management, SLAs, release management and operational readiness.
- Experience with in banking, financial services or another highly regulated enterprise environment.
Experience:
- Candidates should demonstrate practical experience in one or more of the following:
- Agent orchestration frameworks such as Lang Graph, Auto Gen, AWS Bedrock Agents or Microsoft Foundry Agent Service.
- Model Context Protocol, tool-calling APIs and agent state or memory management.
- Retrieval-augmented generation and vector database infrastructure.
- Cloud‑agnostic model serving using tools such as ONNX, BentoML, Triton Inference Server or vLLM.
- MLOps platforms such as MLflow, Kubeflow or Airflow.
- GPU cluster management and inference or training workload optimisation.
- Prompt-injection prevention, output filtering, data‑exfiltration controls and AI threat modelling.
Experience:
- Candidates should have experience with some combination of:
- AI or cloud cost attribution and tagging.
- Chargeback and showback models.
- Token, GPU, DBU or…
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×