Senior AI Software Engineer – Agentic AI ​/ Python

Back Senior AI Software Engineer – Agentic AI / Python

Title:Senior AI Software Engineer – Agentic AI / Python
Location:Orlando, FL (onsite 4 days per week)
Contract:W2 only, 12 month contract with potential for extension or conversion to full time with either the client or CEI
Pay:$75-$80/hour + optional medical, dental, vision, 401(k) match

We are seeking a Senior AI Software Engineer to help advance and product ionize a sophisticated agentic AI platform. This role will focus on taking an existing, highly functional AI agent prototype and evolving it into a scalable, observable, and production-ready solution. You will work in a highly iterative environment where experimentation, rapid feedback, and continuous improvement are expected.

• Design, build, and enhance production-grade Python services supporting agentic AI applications.
• Develop and refine multi-agent LLM workflows using frameworks such as Google ADK, Lang Graph, A2A, or comparable technologies.
• Implement agent orchestration, tool use, guardrails, structured outputs, and workflow logic.
• Help transition advanced AI prototypes into scalable, reliable production services.
• Establish and improve logging, monitoring, tracing, observability, and operational visibility for AI agents.
• Develop evaluation strategies for LLM and agent performance, including quality, safety, accuracy, and behavioral metrics.
• Support A/B testing and experimentation to continuously improve agent performance.
• Build and maintain integrations with services and APIs consumed by AI agents.
• Work extensively with GCP and Vertex AI for AI services, model serving, retrieval, search, and related platform capabilities.
• Apply prompt engineering techniques to improve agent behavior and response quality.
• Design reliable structured outputs and schemas using tools such as Pydantic.
• Containerize services and support automated build, test, deployment, and CI/CD processes.
• Collaborate with product and engineering teams in a fast-moving Agile environment.
• Troubleshoot production issues across AI agents, backend services, integrations, and supporting infrastructure.
• Continuously iterate on architectures, prompts, tools, and workflows as the platform evolves.

• Strong professional experience developing production-grade Python applications and backend services.
• Advanced knowledge of asynchronous Python, including async/await, concurrency, and asynchronous service architectures.
• Hands-on experience with FastAPI, ASGI, or comparable Python API frameworks.
• Proven experience developing agentic or multi-agent LLM applications.
• Experience with Google ADK, Lang Graph, A2A, or similar agent orchestration frameworks.
• Strong understanding of agent tool use, orchestration, workflows, guardrails, and state management.
• Hands-on experience with LLMOps, AI evaluation, or agent evaluation.
• Experience with tools or platforms such as Phoenix/Arize, Vertex AI Evaluation, Open Telemetry, or comparable observability and evaluation technologies.
• Strong experience with Google Cloud Platform and Vertex AI.
• Experience building production services with containers and modern CI/CD practices.
• Experience with observability, logging, monitoring, and tracing within distributed production systems.
• Strong prompt engineering skills and experience refining LLM behavior through experimentation and evaluation.
• Experience designing structured LLM outputs and schemas using Pydantic or similar technologies.
• Strong software engineering fundamentals and the ability to work effectively in a rapidly evolving, highly iterative environment.

• Bachelor’s degree in Computer Science, Software Engineering, Information Technology, Engineering, or a related technical field required.

• Experience with Retrieval-Augmented Generation (RAG), embeddings, and vector search.
• Experience supporting large-scale MySQL or other relational database environments.
• Knowledge of enterprise authentication and authorization, including OAuth2 and scopes.
• Experience with MLOps platforms, experimentation, and model or prompt tracking.
• Experience mentoring…