AI Researcher; Remote
-
Research/Development
Job Description & How to Apply Below
The application window is expected to close on: 01/24/2027
This position is hybrid in the Bay Area, New York City, or Seattle, WA. Fully remote candidates within the USA will also be considered.Meet the Team
The Splunk Agent Resilience team is defining the future of AI resilience. Our team provides scalable, cost-effective evaluation and guardrails that ensure AI agents behave as intended, improving reliability and reducing risks. This unified approach empowers our customers to confidently deploy and manage AI-powered applications with enhanced observability and control.
Your ImpactYou will independently own applied research problems that help organizations understand, evaluate, and improve AI agents across complete workflows. Your work will span agent evaluation, behavioral failure discovery, agent understanding, simulation, and optimization. You will develop novel algorithms and research methods, validate them through rigorous experimentation, and build generalizable AI solutions that balance quality, latency, and cost. You will construct datasets and benchmarks, incorporate human judgment, and validate ideas through controlled experiments, strong baselines, ablations, and systematic error analysis.
Working with researchers, Product, Engineering, and customers, you will take an important research problem from hypothesis to a reproducible result and a useful product capability.
- Independently lead applied research work streams, from hypothesis development and dataset preparation through model training, evaluation, and implementation.
- Train and fine-tune small language models (SLMs) using supervised fine-tuning (SFT), parameter-efficient methods such as LoRA, and other post-training techniques.
- Develop and curate large-scale training datasets using real-world data, simulation, and synthetic data generation, including establishing labeling guidelines, analyzing annotation disagreements, and validating data quality.
- Research and implement improvements to training objectives, data mixtures, sampling strategies, and model adaptation methods, including applying approaches from research literature and developing new methods.
- Design and execute controlled experiments, baseline comparisons, and ablation studies to evaluate model performance, robustness, generalization, and failure modes.
- Develop reproducible model training and evaluation pipelines, documenting methodologies and findings to support continued research and product development.
- Collaborate with Product Management and Engineering to evaluate model behavior, address deployment constraints, and integrate validated research methods into production workflows.
- Communicate technical findings through research code, experimental reports, model documentation, and discussions with technical and non-technical stakeholders.
- Collaborate with global teams and customers, including occasional meetings outside standard local business hours to accommodate different time zones.
- Bachelor's degree in Computer Science, Machine Learning/Artificial Intelligence, Mathematics, or a related field with 8+ years of related experience, or a Master's degree with 6+ years of related experience, or a PhD with 3+ years of related experience.
- Experience applying machine learning or AI research to deployed products or practical business problems, including independently leading research work streams from problem definition through experimentation, evaluation, and implementation.
- Experience training and fine-tuning encoder or decoder transformer models using supervised fine-tuning (SFT) or parameter-efficient methods such as LoRA.
- Experience developing machine learning solutions using Python and deep learning frameworks such as PyTorch, Tensor Flow, or equivalent, including model training, optimization, and evaluation.
- Experience developing and evaluating machine learning datasets, including data sourcing, curation, labeling, synthetic or simulation-based data generation, and experimental validation.
- Master's degree or PhD in Machine Learning, Computer Science, Statistics, or a related field.
- Experience designing and executing controlled experiments, including baseline comparisons, ablation studies, leakage prevention, statistical analysis, and systematic error analysis.
- Contributions to novel modeling, training, evaluation, or data generation methods demonstrated through research publications, open-source implementations, or documented…
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction