Inference & Model Quality Engineer
Job in
San Diego, San Diego County, California, 92101, USA
Listing for:
HostYourAI
Full Time
position
Listed on 2026-11-15
Job specializations:
-
Software Development
Job Description & How to Apply Below
Help run open language models efficiently on GPU infrastructure and establish a consistent way to measure their quality. The work spans model serving, performance and cost tuning, evaluation, and improvements to an in-house Dutch model, with results documented for users and regulatory transparency.
Responsibilities- Deploy and operate models on GPUs using serving frameworks such as vLLM, with SGLang planned.
- Assess hardware fit and serving cost through VRAM estimates, quantization, and related trade-offs.
- Benchmark throughput and latency, then improve performance and cost per token.
- Build a shared evaluation harness covering quality, Dutch-language ability, grounding, tool use, and speed.
- Create datasets, run fine-tuning experiments, and compare new model versions against prior ones.
- Publish model cards and benchmarks, including required AI Act transparency information.
- Experience serving models on GPUs, fine-tuning language models, or both.
- Familiarity with approaches such as SFT, DPO, or LoRA, or model-serving tools such as vLLM and SGLang.
- A measurement-led approach using benchmarks, evaluations, and statistics where appropriate.
- Python, Linux, containers, and common ML tools such as Hugging Face or PyTorch.
- Fluent English, residence in the Netherlands, and the ability to work independently.
- Dutch language skills, especially for judging the quality of Dutch model outputs.
- Remote work, with a headquarters in Groningen.
- Competitive salary, described as top of market.
- Team weeks abroad twice a year and an early role with meaningful ownership.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction