Software Engineer III - MLOps

As a Software Engineer III – MLOps at JPMorgan Chase as a part of Banking and Wealth Management Technology, you build and operate a machine learning operations (MLOps) platform on Amazon Web Services (AWS) that supports model development, CI/CD, deployment, monitoring, and governance across multiple environments

We are building a secure, resilient machine learning delivery ecosystem that helps teams move faster without compromising controls. In this role, you will develop platform foundations—Infrastructure as Code, Kubernetes patterns, multi-environment governance, and operational excellence—so product and data teams can deploy and operate models with confidence. You will collaborate across engineering, data, and risk partners to standardize best practices, strengthen reliability, and improve developer experience.

The work spans build, run, and continuous improvement across multiple environments.

You will contribute to platform resiliency through high-availability designs, multi-Availability Zone patterns, capacity planning, and incident readiness. You will define observability standards to ensure services are measurable, diagnosable, and supportable in production. Your work will help teams deliver batch and online inference safely with standardized deployment and rollback approaches.

• Five years of experience in platform engineering, software engineering, or machine learning operations roles.
• Hands-on experience building and operating production platforms on AWS.
• Hands-on experience with Kubernetes, including Amazon EKS, Helm or Kustomize, ingress, autoscaling, and workload scheduling.
• Hands-on experience using Terraform for repeatable environment provisioning and controlled change management.
• Demonstrated experience using approved AI-assisted software development tools to support coding, code review, testing, troubleshooting, and documentation, with clear validation practices for correctness, performance, and security.
• Knowledge of responsible AI use in engineering workflows, including data sensitivity awareness and secure handling of inputs and outputs.
• Experience implementing security controls for cloud and Kubernetes platforms (for example: identity and access management, role-based access control, secrets management, network policies, and vulnerability management).
• Experience designing and operating highly available systems, including on-call readiness, incident response, and post-incident reviews.
• Experience establishing or operating observability practices across metrics, logs, traces, dashboards, alerting, and service-level objectives (where defined).
• Experience building and operating streaming pipelines with Apache Kafka and Apache Flink.
• Proficiency in one or more programming languages used in platform or streaming engineering (for example: Python, Java, Scala, or Go), plus CI/CD automation experience.

• 5+ years (or equivalent) in platform engineering, Java, or MLOps roles.
• Hands-on experience building production platforms on AWS.
• Strong Kubernetes experience, including Amazon EKS, Helm/Kustomize, ingress, autoscaling, and workload scheduling.
• Strong Terraform experience for repeatable environment provisioning and change management.
• Demonstrated experience leading effective use of approved AI-assisted software development tools (e.g., for coding, code review, test acceleration, troubleshooting) with the ability to set team expectations for validating AI outputs for correctness, performance, and security
• Strong understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; experience coaching…