Senior AI & LLM Systems Engineer
Job in
Charlotte, Mecklenburg County, North Carolina, 28201, USA
Listing for:
Whizzly Lab
Full Time
position
Listed on 2026-11-15
Job specializations:
-
Software Development
Job Description & How to Apply Below
Design and operate production AI systems that combine language models, agent workflows and multimodal retrieval. The work spans architecture, model deployment and evaluation, with a focus on responsive services that can handle substantial query volume.
Responsibilities- Build stateful, multi-agent workflows using orchestration frameworks or custom components.
- Develop hybrid retrieval pipelines, including vector search, chunking, reranking and semantic caching.
- Fine-tune open-weight models and deploy inference services with strict latency targets.
- Create automated evaluations to detect hallucinations and catch prompt regressions.
- Collaborate with product leaders and customer teams to define and deliver AI features.
- At least four years of software engineering experience, with strong Python and FastAPI skills.
- Experience operating reliable LLM applications in production.
- Knowledge of vector databases and semantic search methods.
- Understanding of token costs, streaming responses and prompt design.
- Experience with Docker, cloud deployments on AWS or GCP, and CI/CD.
Position Requirements
10+ Years work experienceTo View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction