Skip to content
×

Principal AI​/ML Engineer

Listing for: LHH
Full Time position Listed on 2026-11-16
Job specializations:
Salary/Wage Range or Industry Benchmark: 180000 - 240000 USD Yearly USD 180000.00 240000.00 YEAR

Job Description & How to Apply Below

LHH is partnering with an global firm that is expanding its investment in AI and looking for a senior, highly hands-on engineer to help build the technical foundation behind its next generation of AI solutions.

This is not a traditional AI application-development or prompt-engineering role. We’re looking for someone who understands what happens beneath the API layer and can work across infrastructure, models, deployment, serving, monitoring, integrations, and production support.

The right person will be equally comfortable experimenting with an open-source model, troubleshooting GPU or resource constraints, building an inference environment, writing Python, deploying containers, and figuring out a technical problem that doesn't already have a playbook.

What You’ll Do
  • Partner directly with executives and senior stakeholders to translate complex business needs into practical AI strategies and technical solutions.
  • Serve as a trusted technical advisor when evaluating AI opportunities, risks, architecture, infrastructure, and emerging technologies.
  • Design, build, deploy, operate, and troubleshoot production AI/ML environments.
  • Deploy and optimize open-source and locally hosted AI models, including models such as Llama, Mistral, Qwen, Gemma, or comparable technologies.
  • Build and support AI workloads running on GPU-backed infrastructure.
  • Evaluate model size, GPU memory, RAM, quantization, inference requirements, latency, throughput, and available compute when designing solutions.
  • Build and maintain model-serving and inference environments.
  • Take AI solutions from early experimentation through production deployment and ongoing operational support.
  • Build and integrate LLM, RAG, retrieval/search, agentic AI, and workflow automation solutions.
  • Develop APIs and integrations across structured and unstructured enterprise data sources.
  • Containerize and orchestrate AI workloads using technologies such as Docker and Kubernetes.
  • Implement monitoring, observability, evaluation, and performance testing across AI systems.
  • Troubleshoot complex issues across infrastructure, model, application, integration, and data layers.
  • Evaluate when hosted AI platforms make sense versus when solutions should be deployed within internally controlled infrastructure.
  • Research and experiment with emerging models, inference frameworks, infrastructure, and deployment technologies.
  • Work independently through ambiguous technical challenges while collaborating with both technical and nontechnical stakeholders.
  • Help establish scalable, secure, and repeatable approaches to delivering AI solutions.
What We’re Looking For
  • 5+ years of significant hands-on AI Infrastructure, MLOps, platform engineering, systems engineering, or related experience.
  • Experience deploying AI/ML workloads into production rather than exclusively consuming hosted AI APIs.
  • Hands-on experience deploying or experimenting with open-source/local models.
  • On the job or home lab experience with GPU-backed AI workloads
  • Can speak to your understanding of GPU memory / VRAM, System RAM and capacity, Model sizing, Quantization, Inference performance, Resource constraints, Latency and throughput
  • Strong infrastructure fundamentals across areas such as Linux, servers, compute, networking, storage, memory, performance, and troubleshooting.
  • Strong software engineering skills with Python or another applicable programming language.
  • Experience with Docker, Kubernetes, APIs, and modern deployment practices.
  • Experience with model serving/inference technologies such as vLLM, NVIDIA Triton, Hugging Face, Ollama, Ray Serve, TGI, llama.cpp, or comparable tools
    .
  • Understanding of RAG, embeddings, vector search, information retrieval, structured/unstructured data, and model evaluation.
  • Experience implementing…
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction

Search for further Jobs Here:

SEARCH JOBS: 10+ Million Listings
(Try combinations for better Results! Or enter less keywords for broader Results)
Education Level
Experience Level (years)
Posted in last:
Salary