Senior Specialist - Architecture

Senior Specialist - Architecture

Job Summary:

<

Required Qualifications <
Must Have:<
Strong software engineering fundamentals and proficiency in Python plus Java Go Type Script is a strong plus<

Experience of working with Codex.<
Proven experience building LLM powered applications in production tool calling function, calling structured outputs retrieval and evaluation. Experience designing distributed systems and APIs REST, RPC plus event driven patterns Kafka, SQS, Pub Sub. Solid understanding of data engineering basics SQL data modeling feature engineering and data quality Handson knowledge of cloud platforms AWS or Azure or GCP containers, Docker and orchestration Kubernetes preferred.<
Ability to write clean testable secure code comfortable with code reviews and engineering rigor<

Experience with multiagent systems planning verification and autonomous workflow execution<

Experience with vector databases hybrid search and knowledge graphs<
Familiarity with model evaluation offline evals golden datasets adversarial testing regression harnesses and AB testing.< <
Technical

Skills:

<
Agent frameworks Lang Graph Semantic Kernel similar orchestration frameworks or equivalent custom implementations< RAG tooling embedding pipelines hybrid retrieval reranking chunking strategies citation provenance<
Observability Open Telemetry structured logging dashboards ing Data systems OLTP analytics warehouses lakes streaming pipelines feature stores optional Testing unit integration tests for tools replay tests for agent traces eval harnesses for LLM outputs <

Key Responsibilities:

< 1. Agentic AI System Design Engineering<
Design and implement agent architectures planner executor tool using agents multiagent orchestration reflection evaluation loops.<
Build tooling integrations for agents merchant systems underwriting platforms transaction stores risk engines CRM case tools knowledge bases and workflow engines.<
Implement robust state management session memory task plans provenance traceability and replay ability of agent actions  2. LLM RAG Engineering for Payments Workloads Develop RAG pipelines over policies SOPs card network rules underwriting guidelines dispute playbooks and merchant agreements.<
Apply prompt and system design structured output patterns and schema validation for deterministic agent behaviour.<
Optimize for latency cost and reliability using caching model routing and evaluation driven prompt iteration.< < 3. ML Decisioning Integration<
Combine LLM agents with classical ML models fraud scoring anomaly detection risk scoring and rules engines.<
Build feedback loops from outcomes chargeback win rate false positives approval uplift to continuously improve models and agent strategies.< < 4. Safety Compliance and Responsible AI<
Implement guardrails PII handling policy enforcement prompt injection defences tool per missioning rate limiting and safe failover. Ensure auditability why an agent took action evidence used and human approval where required humanintheloop. Â 5. Productionization MLOps LLMOps<
Build CICD for agent services evaluation suites telemetry drift detection and incident response playbooks.<
Instrument agent behavior using tracing spans structured logs and metrics task success tool errors hallucination indicators< < 6. Collaboration Leadership <
Partner with Product Risk Ops Underwriting Compliance and Engineering to convert business problems into deployable AI solutions.<
Mentor engineers set standards for agent design patterns testing and production readiness. Alpharetta - Georgia - USA8 - 12 Years
10H Alpharetta - Georgia - USA
09-Apr-2026

YACTIVE
1454796 Mandatory

Skills:

AI native Software development, AI tools like Claude code or OpenAI Codex, Python AI, Java, Spring boot, LLM, RAG, Agentic AI, ML, Productionization MLOps, LLMOps Good to Have

Skills:

AI/Generative AI, GCP Cloud Architecture & Services

Job Title:

AI Engineer with Agentic AI Exp.<

Location:

Berkeley Heights, NJ / Alpharetta, GA (5 Days onsite)