Gen AI Engineer

Job Description

We are seeking a highly skilled engineer to design, build, and operate production‑grade Agentic AI and Generative AI systems end‑to‑end. This role focuses on delivering scalable, secure, and observable services—not prototypes—by combining strong software engineering principles with modern AI practices such as RAG, multi‑agent orchestration, evaluation frameworks, and policy‑driven architectures. You will work on building robust APIs, reusable components, and enterprise‑grade pipelines that integrate LLMs, tools, and business systems to deliver measurable outcomes.

• Agent & Application Engineering Design and implement multi‑agent systems (MAS) with planning, tool usage, and delegation (e.g., Lang Graph, Semantic Kernel). Develop and expose services via REST/gRPC APIs using frameworks such as FastAPI, Express, Java, or Go. Build secure tool adapters (SQL, search, document stores, APIs, code execution) with strict type contracts and sandboxing. Integrate LLM gateways (OpenAI, Azure OpenAI, Bedrock, Vertex AI, or self‑hosted models like vLLM/TGI) with routing, retries, rate‑limiting, and fallback strategies.
• Retrieval, Data & Knowledge Systems:
  Build and optimize RAG pipelines: chunking, embedding, indexing, and hybrid/vector search. Implement data ingestion pipelines using Airflow, Prefect, Celery, or Ray. Process structured and unstructured data sources (documents, chat logs, CRM/ERP systems). Apply PII redaction, metadata governance, and compliance controls. Improve retrieval quality using re‑ranking, query rewriting, and evaluation frameworks.
• Quality, Testing & Evaluation:
  Treat prompts and workflows as code: versioning, testing, and regression management. Develop evaluation frameworks covering latency, cost, accuracy, hallucination, and safety metrics. Build automated CI‑integrated test harnesses (golden datasets, regression suites). Implement drift detection, rollback mechanisms, and fail‑safe controls.
• Platform Engineering & Operations:
  Containerize services and deploy to Kubernetes using Helm and Argo CD. Configure autoscaling (HPA/VPA) and resource optimization. Implement policy enforcement and guardrails (OPA/Gatekeeper, Presidio, Trivy). Establish deep observability using Open Telemetry, Prometheus, ELK/Open Search. Monitor cost, performance, and system health across models and services.
• Security & Compliance:
  Manage secrets using Vault/KMS and enforce least‑privilege access. Ensure secure software supply chain (image signing, SBOMs). Design multi‑tenant architectures with data isolation and residency controls. Implement AI safety mechanisms, including jailbreak defense and adversarial testing.
• Integration & Enterprise Workflows:
  Develop integrations with SAP, CRM, ITSM platforms, and event‑driven systems (Kafka). Build idempotent, resilient processors for distributed systems. Automate business workflows with scalable, pro‑code solutions.
• Collaboration & Leadership:
  Partner with Product, Data, and Platform teams to define SLAs, SLOs, and success metrics. Lead design reviews, architecture discussions, and postmortems. Mentor engineers on production‑grade AI engineering practices.

• Required 8+ years of software engineering experience building production‑grade systems. Proven experience leading small projects or technical initiatives.
• Strong proficiency in at least one language:
  Python, Type Script, Go, or Java. Hands‑on experience with containers & Kubernetes, CI/CD pipelines, Terraform, cloud platforms (AWS, Azure, or GCP), building LLM‑based applications (RAG, agents, prompt engineering).
• Solid data engineering skills: SQL, pipelines, search indexes, vector databases.
• Strong testing mindset: unit, integration, and performance testing.
• Understanding of security fundamentals (IAM, secrets management, policy enforcement).
• Preferred production experience with Lang Graph, Semantic Kernel, or similar orchestration frameworks.
• Experience with distributed compute frameworks (e.g., Ray).
• Expertise in search optimization (BM25 + vector hybrid, re‑ranking strategies).
• Strong background in observability and performance tuning.
• Experience in regulated or…