Principal AI Architecture Leader — Hybrid, MLOps & Security
Germany, Pike County, Ohio, USA
Listed on 2026-02-16
-
IT/Tech
AI Engineer, Systems Engineer
The applied
AI Initiative elevates Europe’s industry to become shapers in the age of AI, creating a future that we desire to live in. Through our ecosystem of strong partners, comprehensive programs, services and solutions we advance companies holistically on their AI journey. With our uniquely diverse, interdisciplinary, and driven team, we build on deep technical expertise while specializing on applicability of the solutions.
We share a mindset of collaboration and openness with our ecosystem of leading companies and tech players. Our common goal is to strengthen the European landscape, jointly creating unique knowledge for applying trustworthy AI. We believe that AI Agents will be the dominant topic for AI in the near future and that applied
AI with its partner ecosystem will impact how this technology is being used in industry and beyond in Europe.
As a Principal Software Architect focused on AI Architecture in Professional Services, you define reference architectures, govern standards across programs, and lead high-impact transformations with enterprise clients. You combine strategic architecture with hands-on depth to deliver robust, scalable, and compliant AI systems at scale.
Your responsibilities will include:
- Define architectural vision and strategy for multi-team delivery of complex AI-enabled software systems, ensuring coherence, scalability, and technical excellence
- Lead discovery, design, and critical solutioning workshops, setting reference architectures, standards, templates, and best practices across engagements
- Architect LLM/ML platforms (serving, retrieval/RAG, evaluation, guardrails) and the MLOps backbone (registries, CI/CD, rollout/rollback). Engineer for SLOs/SLAs, resilience, security, and cost efficiency across cloud and on-prem deployments
- Set and enforce standards for architecture design, code quality, observability, security, data governance, and compliance—including EU AI Act implications
- Mentor and guide engineering teams and clients, providing technical leadership during spikes, de-risking activities, and key decision points
- Partner with sales and delivery leadership in pre-sales, scoping, estimations, proposals, and stakeholder alignment, representing technical vision to clients and business leaders
You can choose to work from our vibrant offices - either at the IPAI in Heilbronn or the House of Communication in Munich - while also enjoying the flexibility to work remotely a few days each week
Lease a bike for a cheaper rate via Job Rad and we cover the bike insurance on top
You can take a sabbatical of up to 3 months after min. 3 years of employment - because sometimes 30 vacation days are not enough to explore the beauty of this world
Every month we contribute to your individual mobility usage with public transport or shared mobility offers within the app Moovster
Work from anywhere in the EU/EWR area for up to 3 months per year - combining working at a nice place and spending your leisure time in the evening like vacation
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).