Gen AI Engineer
Job in
Charlotte, Mecklenburg County, North Carolina, 28245, USA
Listed on 2026-11-05
Listing for:
Ekcel Technologies Inc
Full Time
position Listed on 2026-11-05
Job specializations:
-
Software Development
AI Reliability/ Performance Engineer, AI QA / Validation Engineer
Job Description & How to Apply Below
Position:
Observability & Evaluation AI Engineer
Worksite:
Charlotte, NC- 2-3 days Onsite
Duration:
Contract Opportunity
Job Description: Observability & Evaluation Engineer will build telemetry, tracing, dashboards, evaluation suites, alerts, service objectives, runbooks, and readiness evidence for Tachyon agent releases. This role ensures production AI systems can be monitored, evaluated, improved, and supported with clear operational visibility.
Key Responsibilities- Implement observability and telemetry for LLM-powered applications, agents, tools, and platform services.
- Build evaluation suites for agent behavior, prompt quality, response quality, retrieval performance, latency, reliability, and safety signals.
- Develop dashboards, alerts, traces, metrics, service objectives, and reporting for production readiness.
- Work with platform engineers and Product Owners to define monitoring requirements and evaluation metrics.
- Automate evidence collection for release readiness, operational reviews, and governance checkpoints.
- Create runbooks and support documentation for priority agent releases.
- Analyze production behavior and recommend improvements to reliability, performance, and quality.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×