Research Data Scientist

Innodata(Nasdaq: INOD) is a global data engineering company. We believe that data and Artificial Intelligence (AI) are inextricably linked.

Our mission is to enable the responsible advancement of artificial intelligence by providing the data, evaluation frameworks, and human expertise required to build AI systems that can be trusted  provide a range of transferable solutions, platforms, and services for Generative AI / AI builders and adopters. In every relationship, we honor our 36+ year legacy delivering the highest quality data and outstanding outcomes for our customers.

We are looking for a highly skilled Research Data Scientist – GenAI/LLM to join our AI/LLM Delivery Unit and work on research-driven AI/ML initiatives involving Generative AI, Large Language Models (LLMs), NLP, multimodal AI, model evaluation, and AI data.

The role combines strong research and analytical capabilities with hands-on AI/ML expertise, requiring the candidate to design experiments, develop evaluation methodologies, analyze complex datasets, build research prototypes, and translate research findings into practical AI/ML solutions.

The ideal candidate will have a strong research orientation, excellent statistical and analytical skills, and the ability to work collaboratively with researchers, data scientists, AI/ML engineers, domain experts, and client-facing teams.

AI/ML & Generative AI Research:

• Conduct independent and collaborative research in Generative AI, LLMs, NLP, multimodal AI, machine learning, model evaluation, and AI data.
• Formulate research questions and translate complex AI/ML problems into structured research methodologies and experiments.
• Design, execute, and analyze experiments to evaluate and improve AI/ML models and solutions.
• Build analytical models, prototypes, and research pipelines using Python and relevant ML frameworks.
• Stay current with emerging research, methodologies, papers, and developments in GenAI, LLMs, NLP, multimodal models, and AI evaluation.
• Develop and implement LLM evaluation frameworks, benchmarks, datasets, and evaluation criteria.
• Evaluate models for accuracy, robustness, bias, hallucination, reasoning, relevance, response quality, and other performance dimensions.
• Conduct model benchmarking, error analysis, comparative analysis, and performance evaluation.
• Work on areas such as RAG, SFT, RLHF/DPO, prompt engineering, fine-tuning, embeddings, and LLM optimization, as applicable.
• Identify model and data gaps and recommend improvements to enhance model performance and reliability.

• Collect, clean, analyze, and interpret large and complex structured and unstructured datasets.
• Perform EDA, statistical analysis, hypothesis testing, significance testing, correlation analysis, sampling, and error analysis.
• Develop data-driven insights and identify patterns, trends, and relationships relevant to AI/ML research.
• Apply appropriate statistical and quantitative methodologies to validate research findings

• Develop and evaluate datasets, sampling methodologies, taxonomies, annotation frameworks, data quality frameworks, and evaluation criteria for AI/ML models.
• Analyze data quality and identify issues affecting model performance.
• Collaborate with annotation, data engineering, and AI/ML teams to improve AI training and evaluation data.
• Translate data and research findings into actionable recommendations for improving AI system
• Contribute to research papers, technical reports, whitepapers, patents, benchmarks, internal publications, and other research outputs, where applicable.
• Identify opportunities to apply emerging research and technologies to real-world AI and data challenges.
• Explore new…