Principal Machine Learning Engineer
Remote / Online - Candidates ideally in
Raleigh, Wake County, North Carolina, 27601, USA
Listed on 2026-10-05
Raleigh, Wake County, North Carolina, 27601, USA
Listing for:
Smart Tech Skills LLC
Full Time, Remote/Work from Home
position Listed on 2026-10-05
Job specializations:
-
Software Development
AI Engineer (Applied/Software), Machine Learning/ ML Engineer, Software Architect
Job Description & How to Apply Below
- Competitive salary
Remote to start, then becomes hybrid in Raleigh, NC (relocation required; candidates able to relocate at the start of the contract are preferred, though relocation may occur upon conversion to full-time).
Experience Level
Principal Level (10+ years of experience in machine learning/AI engineering).
Role Overview
We are seeking a Principal Machine Learning Engineer to architect, develop, and advise on end-to-end AI solutions leveraging large language models (LLMs), Retrieval-Augmented Generation (RAG), and agentic systems. This is a senior individual contributor role for someone who wants to remain highly technical rather than move into people management, while providing technical strategy and architectural guidance to a growing data science team.
The ideal candidate has played a lead role in designing and establishing a new agentic RAG-based system, with demonstrated ownership of meaningful architectural and technical decisions - not simply a contributor within a larger team.
Key Responsibilities
AI Architecture & Solution Design
- Architect, develop, and advise on end-to-end AI solutions leveraging LLMs, RAG, agentic systems, and cloud-scale infrastructure.
- Construct, study, and train algorithms that learn from complex, high-dimensionality data to uncover patterns for predictive models and applications.
- Apply techniques such as random forests, deep learning, generative modeling, and neural network memory to improve NLP and machine perception algorithms.
- Develop proofs of concept and initial implementations for new AI capabilities.
- Evaluate and test-drive new frameworks and tools to inform technical direction.
- Work closely with architects to guide teams on AI system design and best practices.
- Provide technical strategy and stay current with industry standards in AI and machine learning.
- Understand the full environment and systems end to end, ensuring production readiness.
- Align AI system design with business and technical goals.
- Deep expertise in LLMs, RAG, and agentic systems.
- Experience with Model Context Protocol (MCP) and vector databases.
- Strong experience with cloud platforms (AWS, Azure, or GCP).
- Strong Python development skills and AI architecture experience.
- Experience with MLOps and software engineering best practices.
- Strong data engineering skills.
- Demonstrated experience designing, architecting, and implementing a new agentic RAG-based system, with evidence of meaningful architectural and technical decision-making (not solely as a contributor within a larger team).
- Engineering experience beyond core data science, including microservices architecture and cloud computing.
- Experience with GoLang.
- Experience working with unstructured data and document-heavy domains.
- Experience supporting or mentoring less senior data scientists/engineers as a technical lead.
- Strong technical depth with a preference for remaining hands-on rather than pursuing people management.
- Proven ability to make and own architectural and technical decisions on complex AI systems.
- Strong collaboration skills, particularly working closely with architects and cross-functional teams.
- Comfortable evaluating and adopting emerging tools and frameworks.
- Excellent communication skills for translating technical strategy across teams.
- Strong end-to-end systems thinking across AI architecture and production environments.
This is a remote position.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×