Principal - Software Engineer

General information

# 20983
Remote? No

Lead the design, development, and scaling of a self-hosted AI Agent Platform on AWS. Drive platform architecture, AI agent orchestration, security, and enterprise adoption. Blend hands‑on engineering with strategic technical leadership. At this time, Ally will not sponsor a new applicant for employment authorization for this position.

• Architect and evolve a self-hosted, AWS-based AI Agent Platform using ECS/Fargate, Lambda, API Gateway, ALB, S3, KMS, Cloud Watch.
• Design scalable, modular infrastructure supporting multiple agent frameworks (Lang Graph, OpenAI Agent SDK, Autogen).
• Define patterns for agent deployment, orchestration, and multi-tenant scaling in containerized environments.
• Build intelligent multi-agent workflows with complex reasoning and tool orchestration.
• Develop reusable SDKs, templates, and developer tooling for faster adoption.
• Integrate agents with enterprise systems such as Service Now, Salesforce, Snowflake, Confluence, Okta, GRC platforms.
• Implement authentication and authorization using Okta OIDC, JWT, and fine‑grained tool policies.
• Establish observability standards including logging, metrics, tracing, and governance dashboards.
• Ensure compliance with enterprise AI governance and risk management frameworks.
• Mentor senior engineers and act as technical thought leader across teams.
• Collaborate with cross-functional stakeholders to drive enterprise-wide platform adoption.

• Bachelor's or Master's in Computer Science, AI/ML, Data Science, or related experience preferred.
• 5+ years of software engineering experience required.
• 3+ years in senior or principal roles preferred.
• Proven experience architecting and scaling distributed systems and AI platforms on AWS.
• Strong Python skills and familiarity with async frameworks like FastAPI and asyncio.
• Experience with AI agent frameworks (Lang Graph, Autogen, OpenAI SDK, MCP).
• Knowledge of LLM orchestration, vector databases, retrieval augmentation, prompt patterns required.
• Expertise in container orchestration, serverless architectures, and CI/CD pipelines (Git Lab, Terraform) preferred.
• Familiarity with cloud security, IAM, networking, and enterprise authentication (Okta) preferred.
• Excellent communication skills and ability to influence technical and executive stakeholders.
• Strategic thinker with hands‑on problem-solving skills.
• Proven record of building platforms or frameworks adopted at scale.

• Competitive holiday and flexible paid‑time‑off, including time off for volunteering and voting.
• Industry‑leading 401(k) retirement savings plan with matching and company contributions, student loan and 529 educational assistance programs, tuition reimbursement, and other financial well‑being programs.
• Flexible health and insurance options including dental and vision, pre‑tax Health Savings Account with employer contributions, and a total well‑being program that helps you and your family stay on track physically, socially, emotionally, and financially.
• Adoption, surrogacy, and fertility support as well as parental and caregiver leave, backup child and adult/elder day care program and childcare discounts.
• Life Matters Employee Assistance Program, subsidized and discounted Weight Watchers program and other employee discount programs.

Emerging: $110,000

Experienced: $145,000

Expert: $180,000

Incentive Compensation:
Eligible to participate in our annual incentive plan.

Ally is an equal opportunity employer committed to diversity and inclusion in the workplace. All qualified applicants will receive consideration for employment without regard to age, race, color, sex, religion, national origin, disability, sexual orientation, gender identity or expression, pregnancy status, marital status, military or veteran status, genetic disposition or any other reason protected by law.

Where permitted by applicable law, must have received or be willing to receive the COVID-19 vaccine by date of hire to be considered, if not currently employed by Ally.

We are committed to working with and providing reasonable accommodation to applicants with physical or mental disabilities. For accommodation requests, email us at  Ally will not discriminate against any qualified individual who is capable of performing the essential functions of the job with or without reasonable accommodation.