AI​/LLM SRE Software Engineer III

Job description

We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer at JPMorgan Chase within the Employee Platforms team, you will be responsible for ensuring the reliability, scalability, and automation of AI-powered applications and infrastructure. You will partner with engineering, and other stakeholders to deliver modern observability, intelligent incident response, and autonomic operations across our applications.

• Ensure reliability, scalability, and performance of AI-assisted application and platform operations.
• Design and implement AI-driven solutions for intelligent alerting, noise reduction & auto-correlation systems.
• Build and maintain observability, monitoring, and telemetry for AI application and platforms.
• Build and support automation for alerting, anomaly detection, and self-healing workflows.
• Collaborate with engineering, and other stakeholders to drive operational excellence.
• Mentor and guide engineers on AIOps standards and operational excellence.
• Define and execute the roadmap for AI-assisted SRE and observability.

• Formal training or certification on software engineering concepts and 5+ years applied experience
• Demonstrates strong experience in SRE, Dev Ops, or Platform Engineering roles.
• Strong hands-on experience with AWS (ECS, Lambda, API Gateway, Bedrock, Cloud Watch, RDS, EKS).
• Hands-on experience with AWS Bedrock, OpenAI, or LLM APIs.
• Expertise in observability tools:
  Open Telemetry, Grafana, Prometheus, ELK, Cloud Watch.
• Experience with CI/CD tools (Git Hub Actions, Jenkins, Spinnaker).
• Proven track record in automation, operational tooling, and event-driven workflows.
• In-depth understanding of distributed systems, microservices, and cloud architectures.

• Experience with AI-powered coding assistants like Git Hub Copilot, windsurf.
• Familiarity with prompt engineering, embeddings, and RAG pipelines.
• Experience building operational copilots or chatbots for runbooks or troubleshooting.
• Proficiency in Python (Go is a plus).

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law.

We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit FAQs for more information about requesting an accommodation. JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans.

We offer a competitive total rewards package including base salary, commission-based pay and/or incentive compensation, and benefits such as comprehensive health care coverage, retirement plan, backup childcare, tuition reimbursement, mental health support, financial coaching, and more.