Sr. Engineer,AI Job New York New York USA,Software Development

Position: Sr. Engineer I, AI
Location: New York

NYU Grossman School of Medicine is one of the nation's top-ranked medical schools. For 175 years NYU Grossman School of Medicine has trained thousands of physicians and scientists who have helped to shape the course of medical history and enrich the lives of countless people. An integral part of NYU Langone Health, the Grossman School of Medicine at its core is committed to improving the human condition through medical education, scientific research, and direct patient care.

At NYU Langone Health equity and inclusion are fundamental values. We strive to be a place where our exceptionally talented faculty, staff, and students of all identities can thrive. We embrace inclusion and individual skills, ideas, and knowledge.

Position Summary

We have an exciting opportunity to join our team as a Sr. AI Engineer. In this role the successful AI Engineer will design, implement, and operate production‑grade Generative AI and Machine Learning solutions that support NYU Langone Healths Remote Patient Monitoring initiatives. You will work at the intersection of healthcare and technology to deploy, monitor, and optimize large language models and supporting services for real‑time clinical workflows, patient engagement, and operational use cases.

Partnering with data scientists, clinicians, care teams, and IT, you will bring practical, reliable, and compliant AI capabilities into the RPM platform and related systems.

Job Responsibilities

Design and implement MLOps/LLMOps pipelines to deploy, monitor, and manage large language models in production healthcare environments, following software engineering best practices and team standards.

Collaborate with data scientists to deploy and/or fine‑tune high‑performing Generative AI models (e.g., for summarization, triage, patient messaging) and apply modern techniques from relevant published work where appropriate.

Develop scalable and robust data and ML pipelines for ingestion, preprocessing, validation, training, evaluation, and model deployment across the RPM ecosystem.

Implement monitoring and observability for AI applications, including tracking performance metrics, latency, model drift, safety indicators, and data quality; maintain model versioning and experiment tracking using tools such as MLflow or Kubeflow.

Evaluate and recommend AI tools and frameworks to meet clinical and operational requirements, including decisions around retrieval‑augmented generation (RAG), vector databases, embedding models, and LLM providers, balancing compliance, performance, and cost.

Optimize inference performance and cost efficiency through techniques such as model quantization, batching, caching, and effective resource allocation; leverage containerization and orchestration tools (Docker, Kubernetes) for scalable, reproducible deployments.

Implement internal security and data protection standards in AI applications; ensure HIPAA compliance and adherence to institutional governance for PHI; assist with emerging AI risk, safety, and security controls.

Support the team in preparation for technical reviews and internal documentation (architecture, IT Security, AI), including design documents, runbooks, and operational procedures.

Collaborate with other team members and stakeholders to meet team objectives; partner with clinicians and product stakeholders to understand workflows, gather feature requirements, identify and document AI opportunities, create appropriate tickets, participate in backlog refinement, execute tickets, and engage in code‑review activities.

Integrate CI/CD practices for AI applications to enable reliable, automated testing, deployment, and rollback in cloud environments.

Stay updated with the latest industry trends and advancements in Generative AI, LLMOps, and relevant cloud technologies; routinely share and demonstrate learnings with the team.

Provide technical guidance and coaching to less experienced team members; contribute to standards, reusable components, and best practices for AI development and operations.

Participate in all phases of the AI software development life cycle, including functional analysis, prototyping, development, evaluation, testing,…

Sr. Engineer , AI