Senior AI Software Engineer; LLM​/GenAI

Purple Drive

Senior AI Software Engineer (LLM / GenAI)

Share Hamilton, NY, Jersey City, NJ

Overview:

Hiring a Senior AI Software Engineer to lead design and delivery of AI-powered applications. Part of the Platform Development team. Focus on bridging LLMs and real financial data through backend architecture. Build systems that make AI practical for financial advisors and clients. Primary focus:
Build and scale text-to-SQL agents. Develop conversational AI tools. Work within a data ecosystem including SQL Server, Microsoft Fabric, and Databricks.

Key responsibilities:

Architect database schemas. Validate AI-generated SQL queries. Build backend services connecting AI to financial data platforms. Core expectation: AI generates SQL, but you must verify correctness and performance. High-impact role involving mentoring engineers, driving architecture decisions, establishing engineering standards, and promoting a culture of experimentation and delivery. Ideal for candidates interested in applying AI to financial services problems.

Responsibilities:

Lead architecture and development of text-to-SQL agent for natural language querying. Architect AI data layer:
Design schemas. Structure data across SQL Server and modern platforms. Validate AI-generated SQL queries (accuracy & performance). Build AI integration patterns:
Prompt engineering. Retrieval-Augmented Generation (RAG). Function calling. Agent-based workflows. Implement AI guardrails for regulated environments. Design and develop backend services and APIs for AI features. Deploy and manage services on Microsoft Azure. Mentor engineers and enforce best practices. Drive engineering standards and technical direction. Collaborate with product, design, and data teams for end-to-end AI delivery.

Qualifications & Skills:

Bachelor's degree in Computer Science or related field (Master's preferred). 7+ years of software development experience. Strong backend/API development on cloud platforms (Azure preferred). Strong SQL expertise:
Writing complex queries. Designing schemas. Evaluating AI-generated SQL. Hands-on experience with LLMs and AI services. Proven delivery of production-grade AI features (not just POCs). Backend technology experience: C# /.NET, Python, Java, or similar frameworks. Experience with data platforms: SQL Server, Microsoft Fabric, Databricks, or equivalents. Demonstrated ability to mentor engineers. Lead technical initiatives. Experience in regulated industries (preferably financial services).