Senior AI Inference Engineer Remote

Responsibilities

• Deploy machine learning models to edge devices using the frameworks: llama.cpp, ggml, onnx.
• Collaborate closely with researchers to assist in coding, training and transitioning models from research to production environments.
• Integrate AI features into existing products, enriching them with the latest advancements in machine learning.

• Excellent programming skills in C++; experience in Java script is a bonus.
• Strong experience with Llama.cpp and ggml inference engines, facilitating the deployment of models to specific GPU architectures.
• Good understanding of deep learning concepts and model architectures.
• Experience with transformers, LLMs, Diffusion models.
• Demonstrated ability to rapidly assimilate new technologies and techniques.
• A degree in Computer Science, AI, Machine Learning, or a related field, complemented by a solid track record in AI R&D.

• Experience with Java script/Typescript.
• Understanding of the difficulties, nuances and importance of P2P technology.
• Experience with Vulkan, Metal and OpenCL.
• Productionized models.