Senior Software Engineer - LLM Benchmarking Lead; Remote
New York, New York County, New York, 10261, USA
Listed on 2026-10-08
-
Software Development
Senior Developer, Software Engineer, Remote Software Developer
Location: New York
24-MAG LLC is seeking a part-time Senior Software Engineer for a remote consulting role focused on advanced LLM evaluation, repository validation, and benchmark development.
You will analyze public repositories, configure reproducible environments using Docker, modify real-world code, and assess model performance on bug-fixing tasks. The contract runs about 20 hours per week for 3 months, with some overlap to PST hours.
We would love to welcome a new Senior Software Engineer - LLM Benchmarking Lead (Remote) to our group in New York, NY, United States.
Our team is growing, and we are hiring a Senior Software Engineer - LLM Benchmarking Lead (Remote) in New York, NY, United States.
This opening is for the Senior Software Engineer - LLM Benchmarking Lead (Remote) role at 24-Mag Llc.
We are seeking a motivated Senior Software Engineer - LLM Benchmarking Lead (Remote) to join 24-Mag Llc in New York, NY, United States.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).