Jr Software Engineer - ML Runtime - Rust

About Tensordyne (formerly Recogni)

AI is transforming our world. It can perform cognitive functions that previously only humans could do, such as perceiving interactions across different modalities and environments - with the ability to quickly learn and then solve complex problems. Tensordyne is an AI system solution company that builds very high-performance, low-power generative AI inference systems. Our mission, through the creation of custom silicon, hardware and software, is to enable multimodal Generative AI inference acceleration at scale, with safe, sustainable, high-performance systems for our hyperscaler and neocloud data center customers.

We are at the leading edge of advancing the latest research and product improvements for generative AI inference solutions that will make AI even more advantageous for compelling new generative AI applications. Tensordyne is a well funded, fast-paced startup company with headquarters in both Sunnyvale, CA, and Munich, Germany. We also have many talented team members working remotely across North America and Europe.

We take care of our people and their families with comprehensive benefits, competitive compensation, flexible spending options, and recognition programs, because building category-defining technology starts with a healthy, supported team. Come join us as we shape the future of multimodal generative artificial intelligence!

As a Software Engineer working within the Low-Level Runtime team, you will build components of an ML model execution framework – low-level assembler architecture hyper-optimized for our hardware – as well as port components of various models to be executed within it.

• Maintain and develop low-level ML model execution framework in Rust
• Maintain and enhance components and whole models written for our hardware
• Optimize performance of ML models, maximizing performance and utilization
• Debug and productize models in both virtual and physical hardware environments

• Experience with Rust programming language
• General awareness of high-level ML model concepts: LLMs, attention architectures
• Experience with low-level code development – e.g. embedded systems
• Experience with driving agents and building LLM engineering workflows

• Experience with Google Cloud Platform or similar
• Experience with Python
• Deep knowledge of modern LLM attention architectures (GDN, DSA, KDA etc)

Tensordyne is an equal opportunity employer.

We believe that a diverse team is better at tackling complex problems and coming up with innovative solutions.

All qualified applicants will receive consideration for employment without regard to age, color, gender identity or expression, marital status, national origin, disability, protected veteran status, race, religion, pregnancy, sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances.