Prompt Engineer
Job in
New York, New York County, New York, 10261, USA
Listed on 2026-05-03
Listing for:
Inizio Partners Corp
Full Time
position Listed on 2026-05-03
Job specializations:
-
IT/Tech
AI Engineer (Applied/Software), Machine Learning/ ML Engineer, Data Scientist
Job Description & How to Apply Below
Role & Responsibilities Overview
- Prompt Design & Optimization
- Design prompts for - summarization, risk insights, adverse media analysis, underwriter assistant agent etc.
- duplicate explanation, decision support
- Optimize prompts for accuracy, grounding, and consistency
- Define evaluation scenarios and validation datasets
- Use LLM-as-judge and feedback loops to improve responses
- Continuously refine prompts based on - model performance, user feedback
- Work with AI engineers to - improve retrieval quality, design context injection strategies
- Ensure outputs are – grounded, explainable, aligned with underwriting logic
- Translate underwriting workflows into prompt logic
- Incorporate domain-specific language, risk indicators, and business rules
- Collaborate with underwriters and SMEs
- Maintain prompt library and versioning
- Define templates for different LOBs and use cases
- Ensure consistency across assistant and workflows
- Experience: 5–8+ years with 2–4+ years in GenAI / prompt engineering
- Domain (Mandatory): Strong insurance / underwriting knowledge
- Education: Bachelor's/Master's in Engineering, Data Science, Business Analytics, or related
- Profile Type: Hybrid business + technical, strong analytical thinker
- GenAI & Prompting - prompt engineering techniques (few-shot, chain-of-thought, structured prompts);
Experience with Azure OpenAI / LLM APIs;
Prompt versioning and optimization - RAG & Retrieval Awareness - understanding of Azure AI Search and retrieval behavior;
Context design and grounding strategies;
Ability to reduce hallucinations via prompt + retrieval design - Evaluation & Quality - LLM-as-judge / evaluation frameworks;
Output validation and benchmarking; A/B testing of prompts - Safety & Governance - Awareness of guardrails (NeMo Guardrails); PII handling (Presidio);
Responsible AI practices - Collaboration & Tools - Familiarity with APIs, JSON, and structured outputs;
Basic Python;
Working with AI engineers and data teams
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×