Mgr - Software Eng

Ally and Your Career Ally Financial only succeeds when its people do - and that’s more than some cliché people put on job postings. We love this stuff! We see our people as, well, people - with interests, families, friends, dreams, and causes that are all important to them. Our focus is on the health and safety of our teammates as well as work-life balance and diversity and inclusion.

From generous benefits to a variety of employee resource groups, we strive to build paths that encourage employees to stretch themselves professionally. We want to help you grow, develop, and learn new things. You’re constantly evolving, so shouldn’t your opportunities be, too?

Work Schedule :
Ally designates roles as (1) fully on-site, (2) hybrid, or (3) fully remote. Hybrid roles are generally expected to be in the office a certain number of days per week as indicated by your manager. Your hiring manager will discuss this role's specific work requirements with you during the hiring process. All work requirements are subject to change at any time based on leader discretion and/or business need.

The Opportunity We are seeking an experienced and hands-on GenAI Tech Lead to drive the end-to-end development of enterprise-grade generative and agentic AI solutions. You will bridge the gap between high-level strategy and hands-on execution—architecting robust systems, leading a talented team of engineers, and transforming complex business challenges into scalable AI products.

The Work Itself

Key Responsibilities

Minimum Qualifications:

7+ years of relevant experience or equivalent combination of education and experience

Bachelor’s Degree in relevant field or equivalent

Preferred Qualifications:

Architecture & Design:
Design scalable, secure, and production-ready GenAI applications utilizing Large Language Models (LLMs), fine-tune and deploy open-source models that meets business needs, Retrieval-Augmented Generation (RAG) pipelines, and vector databases.

Agentic Workflows:
Build and orchestrate multi-agent AI systems and tool-calling frameworks (e.g., Lang Chain, Lang Graph, Auto Gen).Technical Leadership:
Lead code reviews, establish engineering best practices, enforce coding standards, and mentor junior-to-mid-level software engineers.

Prototyping & R&D:
Rapidly build Proof of Concepts (PoCs) and Minimum Viable Products (MVPs) to test emerging AI models and frameworksLLMOps & Monitoring:
Implement monitoring, caching, prompt versioning, cost tracking, and evaluation guardrails for models running in production

Cross-Functional Collaboration:

Partner with product managers, data scientists, security teams, and business stakeholders to align technical deliverables with organizational goals

Experience:

8+ of Software Engineering experience with 5+ years in machine learning engineering, with at least 2+ years hands-on focus building and deploying GenAI/LLM enterprise applications.

Core Technologies:
Advanced proficiency in Python and cloud-native development (AWS, Azure, or Google Cloud).AI Frameworks:
Deep practical knowledge of RAG architectures, vector search, prompt engineering, and orchestration libraries (Lang Chain, Llama Index, Lang Graph).

Infrastructure: Familiarity with CI/CD pipelines, containerization (Docker, Kubernetes), and API microservices.

Soft Skills:

Proven track record of technical leadership, mentoring, and translating complex technical concepts into clear business value. Strong analytical, communication (written and oral), and interpersonal skills. Ability to prioritize workload and balance multiple initiatives and efforts. Ability to respond quickly to a changing environment.

Experience fine-tuning open-weight foundation models.

Background in highly regulated industries (bank/finance) navigating strict…