Principal - Software Engineer

General information

Career area

Technology

Work Location(s)

601 S. Tryon Street, NC

City

Charlotte, NC

Remote?

No

#

20983

Posted Date

10-23-25

Working time

Full time

Ally and Your Career

Ally Financial only succeeds when its people do - and that's more than some cliché people put on job postings. We live this stuff! We see our people as, well, people - with interests, families, friends, dreams, and causes that are all important to them. Our focus is on the health and safety of our teammates as well as work-life balance and diversity and inclusion.

From generous benefits to a variety of employee resource groups, we strive to build paths that encourage employees to stretch themselves professionally. We want to help you grow, develop, and learn new things. You're constantly evolving, so shouldn't your opportunities be, too?

Work Schedule:

Ally designates roles as (1) fully on-site, (2) hybrid, or (3) fully remote. Hybrid roles are generally expected to be in the office a certain number of days per week as indicated by your manager. Your hiring manager will discuss this role's specific work requirements with you during the hiring process. All work requirements are subject to change at any time based on leader discretion and/or business need.

The Opportunity

Lead the design, development, and scaling of a self-hosted AI Agent Platform on AWS. Drive platform architecture, AI agent orchestration, security, and enterprise adoption. Blend hands-on engineering with strategic technical leadership.

At this time, Ally will not sponsor a new applicant for employment authorization for this position.

The Work Itself

* Architect and evolve a self-hosted, AWS-based AI Agent Platform using ECS/Fargate, Lambda, API Gateway, ALB, S3, KMS, Cloud Watch.

* Design scalable, modular infrastructure supporting multiple agent frameworks (Lang Graph, OpenAI Agent SDK, Autogen).

* Define patterns for agent deployment, orchestration, and multi-tenant scaling in containerized environments.

* Build intelligent multi-agent workflows with complex reasoning and tool orchestration.

* Develop reusable SDKs, templates, and developer tooling for faster adoption.

* Integrate agents with enterprise systems such as Service Now, Salesforce, Snowflake, Confluence, Okta, GRC platforms.

* Implement authentication and authorization using Okta OIDC, JWT, and fine-grained tool policies.

* Establish observability standards including logging, metrics, tracing, and governance dashboards.

* Ensure compliance with enterprise AI governance and risk management frameworks.

* Mentor senior engineers and act as technical thought leader across teams.

* Collaborate with cross-functional stakeholders to drive enterprise-wide platform adoption.

The Skills You Bring

* Bachelor's or Master's in Computer Science, AI/ML, Data Science, or related experience preferred

* 5+ years of software engineering experience required

* 3+ years in senior or principal roles preferred

* Proven experience architecting and scaling distributed systems and AI platforms on AWS.

* Strong Python skills and familiarity with async frameworks like FastAPI and asyncio.

* Experience with AI agent frameworks (Lang Graph, Autogen, OpenAI SDK, MCP).

* Knowledge of LLM orchestration, vector databases, retrieval augmentation, prompt patterns required

* Expertise in container orchestration, serverless architectures, and CI/CD pipelines (Git Lab, Terraform) preferred.

* Familiarity with cloud security, IAM, networking, and enterprise authentication (Okta) preferred.

* Excellent communication skills and ability to influence technical and executive stakeholders.

* Strategic thinker with hands-on problem-solving skills.

* Proven record of building platforms or frameworks adopted at scale.

How We'll Have Your Back

Ally's compensation program offers market-competitive base pay and pay-for-performance incentives (bonuses) based on achieving personal and company goals. Our Total Rewards program includes industry-leading compensation and benefits plus additional incentives that are designed to meet your needs and those of your family so you can get the most out of your career and your life, including:

* Time Away:
Program starts at 20 paid time…