AI Project Lead

KCDA's AI Project Lead will help scope, plan and deliver AI-enabled solutions to assist prosecutor workflows. The AI Project Lead will report to the Director of Application Development as part of the Application Development Team, and work collaboratively with Executive stakeholders and end-users to architect scalable AI/ML solutions. The AI Project Lead will act as a trusted advisor in responsibly building tools to serve the Office's core mission of seeking justice.

In this role, the AI project lead will lead a team of developers to participate in early-stage ideation sessions, survey prosecutor defined use-cases, explore multiple solutions, build technology stacks, test and train products for viable outcomes, and deploy enterprise-wide solutions. A successful candidate must have technical skills required for AI application development, project management experience, and a demonstrated ability for strategic planning.

Key responsibilities:

* Analyze, design, implement, maintain, and support AI applications and monitoring solutions for enterprise infrastructure systems and platforms.

* Knowledge of infrastructure for AI/ML related tasks (Cloud and on-prem) is required.

* Technical competency in Python is required.

* A successful candidate must be proficient with AI application architecture scoping and design, and proficiency with LLM fine tuning using frameworks such as Hugging Face, LoRA, or PEFT.

* Account for and mitigate risks during design and implementation regarding data security, data integrity, and AI veracity; implement AI audit logging, explainability mechanisms, and human-in-the-loop workflows.

* A successful candidate will have proficiency with implementing LLM guardrails including hallucination mitigation, PII detection and output validation.

* Review and draft training and internal governance, ensuring compliance with agency standards, propose updates to agency standards in line with industry advancements.

* Train, upskill, supervise, and mentor project teams.

* Communicate with end-users, executive stakeholders and IT supervision regarding use cases, project plans, and recommendations.

* Test local solutions; manage on-premises GPU infrastructure for AI inference and training.

* Test cloud compute.

Experience with Azure, AWS, and/or GCP is required.

* Design and deploy retrieval-augmented generation (RAG) pipelines, test hybrid environments.

* Oversee testing and reporting of quality assurance and quality control of AI use cases.

* Oversee scale-up, training, and deployment.

* Oversee Event Management, Patch Management, Release Management, Change Management development and processes.

* Monitor industry developments, liaise with vendors regarding new products and technologies.

Preferred

Skills:

* Experience managing on-premises GPU infrastructure for AI inference and training workloads.

* User training experience.

* Experience with implementing confidentiality, data security and data integrity protocols; familiarity with government or legal sector data governance requirements including data residency and PII handling.

* Proficiency with the implementation, deployment, and integration of AI applications.

* Experience with automated document processing or de-identification pipelines for sensitive information.

* Experience with speech-to-text pipelines and multilingual NLP or translation workflows.

* Experience with prompt engineering, retrieval-augmented generation, agent/tool-use frameworks, containerization and orchestration of AI workloads.

* Experience with vector databases, including chunking strategies, embedding model selection, and hybrid search approaches; proficiency with embedding models and retrieval evaluation techniques.

* Ability to benchmark and produce metrics on LLM performance, experience with ML experiment tracking, model versioning, and reproducibility practices.

* Ability to effectively communicate AI planning with executive stakeholders.

* Ability to train, upskill, and lead a team of developers.

* Ability to provide technical guidance on internal AI policy.

* Ability to assess and evaluate vendor-provided solutions.

IT AUTOMATION AND MONITORING E - 95712

Minimum Qualifications

1. A baccalaureate degree in computer science, engineering or a related field from an accredited college and four years of satisfactory full-time experience related to IT automation engineering, monitoring engineering, management of infrastructure; or

2. Eight years of satisfactory full-time experience related to IT automation engineering, monitoring engineering, management of infrastructure;

3. Education and/or experience which is equivalent to "1" or "2" above.

55a Program

This position is also open to qualified persons with a disability who are eligible for the 55-a Program. Please indicate at the top of your resume and cover letter that you would like to be considered for the position through the 55-a Program.

Public Service Loan Forgiveness

As a prospective employee of the City of New York, you may be eligible for federal loan…