Senior AI Engineer

3 days ago Be among the first 25 applicants

At MoFo, we couldn’t write our own success story without yours. Ready to write your story? Join MoFo as a SENIOR AI ENGINEER on our Information Technology Team! This role can be based in Boston, New York or Washington, D.C. Office locations

The Senior AI Engineer, aligned with department and firm‑wide objectives under the direction of the Director of Data Science Analytics, designs, integrates, operates, and continuously improves the Firm’s generative‑AI platform built on third‑party providers (e.g., ChatGPT Enterprise). The role also leads structured evaluations of additional providers (e.g., Harvey, Legora) and focuses on building reliable, secure, and compliant services that connect these providers to Firm systems (Service Now, Salesforce, SharePoint/One Drive, iManage, Workday, Microsoft 365), along with custom GPTs and enterprise connectors.

Success is measured by developer and attorney adoption, measurable productivity gains, service reliability, and adherence to Responsible AI and client obligations.

• Co‑own the strategy, roadmap, and daily operations of the Firm’s generative‑AI platform in partnership with the Director of Data Science Analytics.
• Design, implement, document, and maintain scalable, secure REST/Graph
  
  QL services and SDKs that wrap third‑party LLMs and expose agentic and RAG functionality for internal developers.
• Integrate AI services with enterprise platforms including Service Now, Salesforce, SharePoint/One Drive, iManage Cloud, Workday, and Microsoft 365/Copilot & Copilot Studio.
• Build and operate Model Context Protocol (MCP)‑compliant tools and servers; define resource schemas, capability negotiation, and authentication/authorization patterns.
• Maintain vector and embedding stores (e.g., Azure AI Search, pgvector, Pinecone) and RAG pipelines; tune chunking, metadata enrichment, and re‑ranking for legal‑grade accuracy.
• Provide reference implementations, SDK snippets, and quick‑start examples to accelerate adoption by IT and development teams.

• Partner with attorneys, Knowledge Management, and business staff to identify high‑value use cases; co‑design custom GPTs with clear instructions, approved knowledge sources, and guardrails.
• Build and maintain custom connectors (Actions/OpenAPI and enterprise connectors) to systems such as Service Now, Salesforce, iManage, SharePoint/Graph, and internal APIs.
• Establish governance for GPTs, including naming, versioning, review workflows, RBAC/workspace scoping, and data partitioning; manage release channels and deprecations.
• Develop evaluation and safety checks (offline test sets, red‑team prompts, accuracy/latency/cost KPIs) and instrument usage analytics with feedback loops.
• Deliver templates, prompts, and “starter GPTs”; run enablement sessions and office hours for safe self‑service by attorneys and staff.
• Maintain runbooks and support processes for GPT incidents, drift, and provider updates.

• Lead structured evaluations and bake‑offs against ChatGPT Enterprise baselines, defining decision criteria with AI/KM Consultants, Information Security, Governance, Risk, Procurement, and Compliance teams.
• Design representative test suites (accuracy, hallucination rate, retrieval fidelity, tool‑use reliability, latency, throughput, cost) and implement automated evaluation harnesses.
• Support Information Security in performing security and privacy due diligence (SOC 2/ISO mappings, encryption, retention, auditability, incident response) and align with client guidelines.
• Assess interoperability (MCP support, Actions/OpenAPI, webhooks, SSO/RBAC, logging/observability) and integration effort with Firm systems and RAG pipelines.
• Build proofs of concept with attorneys and staff, document ROI and risk, and recommend go/no‑go and migration plans.
• Produce decision memos detailing evaluation criteria, results, mitigations, financial impacts, and vendor lock‑in strategies.

• Implement policy and technical controls for privacy, confidentiality, privilege,…