SR Principal Software Engineer - LLM Engineering

SR Principal Software Engineer - LLM Engineering

and 4 more

• Job Identification
• Job Category Software Engineering
• Business Unit Commercial & Investment Bank
• Posting Date 08/24/2026, 02:52 PM
• Locations 3223 Hanover St, Palo Alto, CA, 94304, US 270 Park Ave, New York, NY, 10017, US 10 S Dearborn St, Chicago, IL, 60603, US 545 Washington Blvd, Jersey City, NJ, 07310, US 1301 2nd Ave, Seattle, WA, 98101, US
• Job Schedule Full time
• Job Shift Day
• Base Pay/Salary Palo Alto,CA $-$;
  Seattle,WA $-$;
  Chicago,IL $-$;
  New York,NY $-$;
  Jersey City,NJ $-$

We’re looking for a tech leader ready to take their career to new heights. Join the ranks of top talent at one of the world’s most influential companies.

As a Senior Principal Software Engineer at JPMorgan

Chase within the Commercial & Investment Bank Trust & Safety Fraud Prevention team, you provide deep engineering expertise and work across agile teams to enhance, build, and deliver trusted market‑leading technology products in a secure, stable, and scalable way. Leverage your deep expertise to consistently challenge the status quo, innovate for business impact, lead the strategic development behind new and existing products and technology portfolios, and remain at the forefront of industry trends, best practices, and technological advances.

Job responsibilities

• Advises and leads on the strategy, architecture, and development of model serving solutions for different model architectures (including LLMs & GNNs) across cloud and on‑premises environments, aligning initiatives to business outcomes.
• Defines and implements MLOps and LLMOps strategies for end‑to‑end model lifecycle management, including training, versioning, deployment, monitoring, and governance.
• Drives optimization of model inferencing for high throughput and low latency using quantization, model parallelism, intelligent batching, and hardware acceleration for all model architectures.
• Sets strategy and operating standards for agentic AI-enabled engineering across a portfolio (using enterprise-authorized tools within the work environment) to drive measurable improvements in delivery speed, reliability, and code quality (e.g., AI-orchestrated SDLC/TLM automation, release readiness gating, incident triage/root-cause acceleration, and large-scale refactoring/test modernization), while defining guardrails for validation, security, resiliency, and reuse across teams and functions.
• Applies knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized AI-assisted development and automation capabilities, to improve the value realized by automation at scale.
• Creates durable, reusable software and platform frameworks to standardize ML Engineering services, enabling scale across teams and functions.
• Establishes best practices for automation, CI/CD, and infrastructure‑as‑code using containerization and orchestration technologies.
• Partners closely with data science, platform engineering, and SRE teams to product ionize models on AWS, ensuring observability, reliability, and cost efficiency.
• Leads deployment and optimization using model inference servers such as Triton Inference Server and vLLM for high‑throughput, low‑latency serving at scale.
• Oversees production operations for AI workloads, including monitoring, incident response, security, and compliance, with continuous improvement.
• Translates complex technical concepts and emerging trends into actionable strategies, influencing senior stakeholders and cross‑functional partners to prioritize and deliver AI/ML capabilities that drive measurable business impact while promoting a culture of diversity, opportunity, inclusion, and respect.
• Required qualifications, capabilities, and skills
  Formal training or certification on software engineering concepts and 10+ years of applied experience.
• 8+ years of AI/ML engineering experience with significant expertise in LLMs, GNNs and other model architectures (e.g., GPT, Llama, Falcon, Mistral).
• Demonstrated success architecting and deploying LLM & GNN solutions on AWS (e.g., Sage Maker, Bedrock, EKS) at enterprise scale; experience with Azure ML or GCP Vertex AI.
• Experience building LLM…