AI Engineer
Listed on 2026-07-01
-
Software Development
AI Engineer (Applied/Software), Machine Learning/ ML Engineer
AI Engineer
Chicago, Illinois, United States
$ - (US Dollar)
About the job AI Engineer
Ally Nds client is a GenAI-first SaaS company revolutionizing how legal teams interact with contracts. Their platform leverages proprietary datasets and fine-tuned language models to extract, summarize, and analyze millions of documents in seconds offering predictive insights and compliance alerts to Fortune 1000 legal teams. The company has secured institutional seed funding and is scaling its AI capabilities with high-value pilot customers.
Job Description
We're hiring an experienced AI Engineer with deep LLM experience to build the next generation of legal intelligence tools. You'll fine-tune models, design RAG pipelines, and build robust evaluation systems all while shaping product direction in a fast-moving startup.
Responsibilities
- Fine-tune and deploy LLMs (e.g., LLaMA, Mistral, Claude) for legal document analysis
- Design and implement Retrieval-Augmented Generation (RAG) pipelines for clause-based Q&A
- Optimize inference workflows for latency, accuracy, and cost-efficiency
- Develop tools for prompt engineering, testing, and prompt versioning
- Collaborate with product and legal SMEs to shape AI features and interfaces
- Evaluate model performance using relevance, accuracy, and hallucination metrics
Required Skills
- 7+ years in ML/AI engineering roles, with a focus on NLP or LLMs
- Strong experience with model fine-tuning, RAG architectures, and transformer-based models
- Proficiency in Python and deep learning frameworks (PyTorch, JAX, Hugging Face)
- Familiarity with vector databases (Pinecone, Weaviate, FAISS)
- Experience deploying LLMs in production with LLMOps or MLOps stacks
Preferred Skills
- Background in legal tech, document automation, or compliance tools
- Experience with Lang Chain, llama
Index, and prompt chaining frameworks - Understanding of AI ethics and hallucination mitigation strategies
Benefits
- Fully remote setup with flexible hours
- Annual learning stipend + GPU compute access
- Comprehensive health benefits and wellness perks
Work Authorization
Candidates must be authorized to work in the U.S. This client cannot sponsor visas now or in the future.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).