Principal - Software Engineer

Ally and Your Career

Ally Financial succeeds only when its people do – and that means recognizing the people behind the work. We view teammates as individuals with interests, families, friends, dreams, and causes that matter. Our focus is on health and safety, work‑life balance, diversity and inclusion, and the generous benefits and employee resource groups that help you grow, develop, and learn new things.

Ally designates roles as (1) fully on‑site, (2) hybrid, or (3) fully remote. Hybrid roles are generally expected to be in the office a certain number of days per week as indicated by your manager. Hiring managers will discuss the specific work requirements during the hiring process. All work requirements are subject to change at any time.

Lead the design, development, and scaling of a self‑hosted AI Agent Platform on AWS. Drive platform architecture, AI agent orchestration, security, and enterprise adoption while blending hands‑on engineering with strategic technical leadership. At this time, Ally will not sponsor a new applicant for employment authorization for this position.

• Architect and evolve a self‑hosted, AWS‑based AI Agent Platform using ECS/Fargate, Lambda, API Gateway, ALB, S3, KMS, and Cloud Watch.
• Design scalable, modular infrastructure supporting multiple agent frameworks (Lang Graph, OpenAI Agent SDK, Autogen).
• Define patterns for agent deployment, orchestration, and multi‑tenant scaling in containerized environments.
• Build intelligent multi‑agent workflows with complex reasoning and tool orchestration.
• Develop reusable SDKs, templates, and developer tooling for faster adoption.
• Integrate agents with enterprise systems such as Service Now, Salesforce, Snowflake, Confluence, and Okta.
• Implement authentication and authorization using Okta OIDC, JWT, and fine‑grained tool policies.
• Establish observability standards, including logging, metrics, tracing, and governance dashboards.
• Ensure compliance with enterprise AI governance and risk management frameworks.
• Mentor senior engineers and act as a technical thought leader across teams.
• Collaborate with cross‑functional stakeholders to drive enterprise‑wide platform adoption.

• Bachelor’s or Master’s in Computer Science, AI/ML, Data Science, or related experience preferred.
• 5+ years of software engineering experience required.
• 3+ years in senior or principal roles preferred.
• Proven experience architecting and scaling distributed systems and AI platforms on AWS.
• Strong Python skills and familiarity with async frameworks like FastAPI and asyncio.
• Experience with AI agent frameworks (Lang Graph, Autogen, OpenAI SDK, MCP).
• Knowledge of LLM orchestration, vector databases, retrieval augmentation, and prompt patterns required.
• Expertise in container orchestration, serverless architectures, and CI/CD pipelines (Git Lab, Terraform) preferred.
• Familiarity with cloud security, IAM, networking, and enterprise authentication (Okta) preferred.
• Excellent communication skills and ability to influence technical and executive stakeholders.
• Strategic thinker with hands‑on problem‑solving skills.
• Proven record of building platforms or frameworks adopted at scale.

Ally’s compensation program offers market‑competitive base pay, pay‑for‑performance incentives (bonuses), and a Total Rewards program that includes:

• 20 paid time off days + 11 paid holidays + 8 hours of volunteer time off yearly.
• 401(k) retirement savings plan with matching and company contributions, student‑loan pay‑down, 529 program, tuition reimbursement, and employee stock purchase plan.
• Health and insurance options covering medical, dental, vision, life, disability, and Wellness programs.
• Paid parental and caregiver leave, adoption support, surrogacy, fertility assistance, and childcare benefits.
• Work‑life integration programs including Employee Assistance, Weight Watchers®, and employee discounts.
• Potential travel allowances, relocation assistance, signing bonus, and equity depending on the role.
• Additional details at Ally Total Rewards Snapshot.

Ally Financial is a customer‑centric, leading digital financial services company with…