AI Engineer III

Position Overview

NBME is seeking a highly skilled AI Engineer to join our team and take ownership of building, maintaining, and scaling AI‑driven systems. This role is critical for translating research innovations into production‑ready pipelines and tools that support multiple programs, products, and services. The AI Engineer will work closely with research, IT, and product teams to operationalize AI solutions, ensuring they are reliable, secure, and optimized for performance.

The role is hybrid
, requiring minimal onsite attendance, but remote work is also an option. Candidates may choose to work primarily remotely, hybrid, or onsite. Possible states include PA, NJ, DE, MD, TX, GA, IA, IL, IN, KS, NC, SC, TN, VT, WV. Onsite interviews and onboarding may be required at our Philadelphia office, with advance notice provided.

• Design, implement, and maintain production‑grade AI and NLP pipelines, including model training, deployment, monitoring, and updates.
• Collaborate with research teams on pre‑production research and operationalize prototypes, ensuring reproducibility, scalability, and robustness.
• Build and maintain infrastructure for embeddings, large language models, and other AI assets.
• Optimize AI systems for performance, reliability, and cost‑efficiency.
• Implement and maintain monitoring, logging, and alerting for AI systems in production.
• Ensure compliance with data security, privacy, and organizational standards.
• Support multiple product teams by providing AI engineering expertise, tools, and best practices.
• Contribute to technical documentation, knowledge sharing, and internal training initiatives.

• Bachelor's or Master’s degree in Computer Science, Engineering, Data Science, or a related field.
• A minimum of 3 years of experience in AI/ML engineering, including model deployment, MLOps, system monitoring, and production pipelines.
• Proficiency with Python and AI/ML libraries (e.g., PyTorch, Tensor Flow, Hugging Face Transformers).
• Experience with cloud platforms (AWS, GCP, Azure) and containerization (Docker, Kubernetes).
• Familiarity with vector databases, embeddings, and large‑scale NLP applications.
• Strong problem‑solving skills and ability to work collaboratively in a cross‑functional team.
• Excellent communication skills for technical and non‑technical stakeholders.

• Experience in educational assessment or healthcare‑related AI applications.
• Experience with Agentic LLM architectures for complex task completion.

Compensation for this position ranges from $118,160 (minimum) to $147,700 per year, based on qualifications, experience, departmental budget, and internal equity review.

Benefits include Healthcare, Dental, Prescription, and Vision plans; 401(k) with match;
Tuition Reimbursement Plan;
Commuter Benefits:
Public Transit or Parking options; and a Remote‑Friendly Workplace.

NBME is an Equal Opportunity Employer. We will consider all qualified applicants for employment without regard to race, color, sex, gender identity, sexual orientation, religious practices and observances, national origin, pregnancy, childbirth, or related medical conditions, status as a protected veteran or spouse/family member of a protected veteran, or disability.