LLM / GenAI Engineer
Job in
Washington, District of Columbia, 20022, USA
Listed on 2026-07-31
Listing for:
Scale.jobs
Full Time
position Listed on 2026-07-31
Job specializations:
-
Software Development
AI Engineer (Applied/Software), Machine Learning/ ML Engineer, Backend Developer
Job Description & How to Apply Below
About The Role
The role is for someone who has moved beyond prompting and understands what it takes to build production-grade AI systems: RAG pipelines, agentic workflows, fine-tuning pipelines, and systematic evaluation frameworks.
About The Role
The role is for someone who has moved beyond prompting and understands what it takes to build production-grade AI systems: RAG pipelines, agentic workflows, fine-tuning pipelines, and systematic evaluation frameworks.
You will own complex pieces of an AI platform and work directly with applied scientists, backend engineers, and enterprise clients.
Key Responsibilities- Design and implement RAG pipelines using Lang Chain, Llama Index, or custom architectures
- Build and optimize vector database integrations (Pinecone, Weaviate, Chroma, pgvector) for semantic search at production scale
- Develop systematic LLM evaluation frameworks: benchmark suites, LLM-as-judge pipelines, regression testing
- Run instruction fine-tuning and parameter-efficient fine-tuning (LoRA, QLoRA) on domain-specific datasets
- Write observable, tested, and well-documented code; participate in architecture reviews
- 2–5 years of software engineering experience, including at least 1 year working with LLMs in production
- Deep familiarity with at least one LLM orchestration framework:
Lang Chain, Llama Index, or equivalent - Understanding of embedding models, vector databases, and semantic similarity in production environments
- Strong Python skills; comfort with async programming, REST API design, and cloud infrastructure
- Bonus:
Experience publishing open-source AI tools, contributions to major ML libraries, or a Master s degree in Computer Science or related quantitative field
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×