Expert AI Engineer

This is a hybrid position.

The Expert AI Engineer owns complex technical work within GenAI and AI platform services, designing and optimizing components of retrieval pipelines, inference systems, and evaluation frameworks. Applies strong debugging, performance engineering, and architectural judgment to improve system reliability and model grounding, while guiding less‑experienced team members and influencing team‑level technical decisions.

GenAI & AI Platform Development:

• Implement and optimize RAG pipelines, embeddings workflows, and LLM integration patterns.
• Contribute to scalable, low‑latency inference architecture.
• Develop and optimize components of real‑time and batch inference pipelines that support document processing, portfolio insights, and decision‑support use cases. Improve pipeline performance, reliability, and integration quality across the team’s GenAI workflows.
• Design sections of ingestion, transformation, and indexing pipelines for vector stores and hybrid retrieval. Design data curation processes and retrieval corpora, working with domain experts to ensure content quality, provenance, and relevance for GenAI use cases.
• Lead improvements in cost‑efficiency, performance, and reliability across components.
• Apply secure‑by‑design principles and contribute to drafting responsible AI guidelines.
• Design and maintain prompt templates, orchestration flows, and model configurations, establishing patterns for versioning, rollback, and auditability across the team’s GenAI workflows.
• Design and implement guardrail patterns (e.g., safety classifiers, content filters, policy checks) that consistently mitigate harmful or non‑compliant outputs across multiple GenAI features.

AI Evaluation & Quality Engineering:

• Design small‑scale evaluation modules measuring grounding, factuality, consistency, and quality.
• Build automated test harnesses and evaluation scripts for model iterations.
• Reduce hallucinations by applying grounding strategies and structured response patterns.
• Partner with SMEs to translate qualitative evaluation findings into engineering revisions. Analyze complex evaluation data to inform design decisions.
• Design evaluation tests and datasets focused on safety, bias, and compliance, and analyze results to propose concrete model or workflow changes.

Software Engineering & System Design:

• Lead design and implementation of core components of GenAI services and pipelines.
• Participate in architectural discussions and propose improvements within the product area.
• Write modular, reusable code used broadly by team members.
• Contribute in technical design reviews and code reviews. Mentor less experienced team members on coding standards, testing, and best practices.
• Conduct detailed performance troubleshooting and optimize system bottlenecks.
• Strong software engineering background with hands‑on AI/ML or LLM integration experience.

Technical

Competencies:

• Strong software engineering background with hands‑on AI/ML or LLM integration experience.
• Deep experience building components of RAG or LLM‑powered systems.
• Experience designing embeddings pipelines, retrieval workflows, and LLM orchestration logic.
• Ability to design evaluation datasets, metrics, and offline test suites.
• Working proficiency with cloud‑native architectures, microservices, and containerization.
• Demonstrates advanced code quality, testing, and documentation practices, delivering well‑structured, maintainable components and ensuring reliability through comprehensive test coverage and clear technical documentation.
• Experience mentoring less experienced team members and influencing design decisions within the team.

• Typically requires 6+ years of professional experience in AI/ML engineering, including ownership of model development and system integration.

We offer a competitive compensation and benefits package, opportunities for career growth, an employee stock purchase plan, 401(k), generous time off and flexible work/life balance, company‑matched retirement packages, an employee wellness program, and an awards and recognition program – all in a creative, fast‑growing, and innovative company.

iPipeline is proud to be an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to gender, race, color, religious creed, national origin, age, sexual orientation, gender identity, physical or mental disability, and/or protected veteran status. We are committed to building a supportive and inclusive environment for all employees.