AI​/ML Engineer – LLM Systems; m​/f​/d

Be Yourself - Because that´s how we want You to be

We can, we want and we are also entitled to - because we are a team of highly motivated and qualified employees who are as passionate about inspiring customers as we are about working on technical solutions. And that makes us unique! If you want to take yourself and our products further, then come to us and shape the future of netcup!

You are passionate about artificial intelligence and enjoy working with cutting-edge LLM technologies? You work in a structured and independent manner and love building intelligent systems that create real value? You are a communicative team player who thrives on implementing innovative AI solutions? Then this position is perfect for you!

• You will drive forward the development and deployment of AI/ML systems, particularly focusing on Large Language Models (LLMs) and intelligent agent frameworks
• You implement and operate LLM inference solutions using runtimes like Ollama, vLLM, and Tensor
  
  RT-LLM
• You develop agentic applications with frameworks such as Dify, Lang Flow, Haystack, Llama Index, Lang Chain, Lang Graph or Pydantic AI
• You integrate AI capabilities from various providers (like OpenAI, Anthropic, Groq, and Cerebras) into production systems
• You implement LLMOps practices using tools like Lang Fuse and Lang Smith for monitoring, tracing, and observability
• You build and optimize ML pipelines using Python, Tensor Flow, PyTorch, and scikit-learn for various AI applications
• You containerize and deploy AI applications using Docker and Podman
• You work with SQL databases and implement evaluation frameworks like Deep Eval to ensure model quality
• You work closely with cross-functional teams and enjoy presenting and continuously improving your AI solutions

• Experience with RAG (Retrieval-Augmented Generation), prompt engineering or multi-agent systems is highly valued
• Strong understanding of Large Language Models and experience with Hugging Face ecosystem
• Hands-on experience with at least one agentic framework (Lang Chain, Lang Graph, Haystack, Llama Index, Dify, Lang Flow, or Pydantic AI)
• Experience with Python and modern ML frameworks (Tensor Flow, PyTorch, scikit-learn)
• Proficiency with LLM inference runtimes such as Ollama, vLLM, or Tensor
  
  RT-LLM
• Experience with LLM APIs (OpenAI, Anthropic, or similar providers)
• Strong knowledge of SQL and database operations
• Understanding of LLMOps practices and model evaluation methodologies
• Experience with containerization (Docker/Podman) and orchestration tools
• Experience with version control systems and CI/CD tools is an advantage
• Knowledge of Dev Ops practices (Ansible) is a plus
• Very good written and spoken German and English skills

We are more than just a workplace. Therefore, we offer our employees many benefits (which partly depend on your position and location): good transport connections and flexible working hours. Period. Not to mention further training, a mentoring program, free parking, a mobile phone and notebook, snacks and drinks, company cars, employee events, a fun corner, ...

Have we sparked your interest?

We look forward to your expressive application!

Founded in 2008, the company has been part of the international Anexia Group since 2016 and, as an Internet Service Provider, serves over 75,000 business and residential customers worldwide. Our main strength lies in the provision of web hosting, virtual and dedicated servers, and support of the same through management services. We also offer our customers a large selection of Top Level Domains.

Worldwide, we serve over 200,000 satisfied customers with 400,000 domains.

Our quality has won several awards - picking up a 'Very good' from CHIP computer magazine.

Part of the Anexia Group with over 400 employees and 6 office locations worldwide.