Skip to content
×

AI Technical Consultant, LLM Safety Evaluation, Digital Impact Division, Digital Guardrails, Home-based

Online/Remoto - Ideal para candidatos en
46001, Valencia, Comunidad Valenciana, España
Empresa: UNICEF - United Nations Children’s Fund
Contrato, Remoto/Desde casa puesto Publicado en 2026-10-11
Especializaciones laborales:
Rango Salarial o Referencia de la Industria: 65000 - 111000 EUR Anual EUR 65000.00 111000.00 YEAR

Descripción del trabajo

Puesto: AI Technical Consultant, LLM Safety Evaluation, Digital Impact Division, Digital Guardrails, Home-based  6 Months and
AI Technical Consultant, LLM Safety Evaluation, Digital Impact Division, Digital Guardrails, Home-based, Valencia, Spain, 6 Months and 20 days #596213

Job no: 596213
Contract type: Consultant
Duty Station: Valencia
Level: Consultancy
Location: Spain
Categories: Information Communication Technology

UNICEF works in over 190 countries and territories to save children’s lives, defend their rights, and help them fulfill their potential, from early childhood through adolescence.

At UNICEF, we are committed, passionate, and proud of what we do for as long as we are needed. Promoting the rights of every child is not just a job – it is a calling.

UNICEF is a place where careers are built. We offer our staff diverse opportunities for professional and personal development that will help them reinforce a sense of purpose while serving children and communities across the world. We welcome everyone who wants to belong and grow in a diverse and passionate culture., coupled with an attractive compensation and benefits package.

Visit our website to learn more about what we do at UNICEF.

For every child, the right to Future

How can you make a difference?

  • Prepare, clean and structure the agreed test prompt set.
  • Conduct extensive testing of agreed prompts across multiple LLM providers and configurations, and curate the most informative model responses for expert review.
  • Run evaluations under different approved safety/content-filter configurations and document how these settings affect model behaviour.
  • Capture model responses and relevant test metadata.
  • Troubleshoot API, model, safety-filter or platform issues.
  • Develop and maintain code to call commercial LLM APIs and, where required, deploy and interact with open-source models for evaluation.
  • Conduct targeted reviews of state-of-the-art child-safety and AI-safety research to identify relevant prompts, failure modes and emerging risks.
  • Organise outputs into a simple format for expert review.
  • Support simple rating, ranking and reviewer comments.
  • Capture review results in a structured, exportable format.
  • Iterate the prototype based on expert feedback.
  • Participate in communication with reviewers, collect feedback on both model behaviour and the review process, and refine the testing/review infrastructure accordingly.
  • Support re-testing when experts identify new failure modes, ambiguities or edge cases.
  • Help translate expert feedback into new or refined test cases.
  • Maintain a clean, versioned prompt-response dataset.
To qualify as an advocate for every child you will have…
  • Education: Advanced university degree (Master’s or equivalent) in computer science, artificial intelligence,

data science, machine learning, information security, human-computer interaction or a related technical

field. A first university degree combined with additional relevant professional experience may be accepted

in lieu of an advanced degree, subject to UNICEF requirements.

Computer Science, Artificial Intelligence, Data Science, Machine Learning, Information Security or related field.

  • Work Experience: Minimum five years of relevant professional experience in AI/ML, software engineering,

data science, model evaluation or a closely related technical field.

  • Skills:
  • Demonstrated hands‑on experience evaluating LLM outputs, including qualitative assessment across multiple models, versions or configurations.
  • Practical experience with prompt testing, AI safety testing and/or AI red teaming.
  • Strong Python skills and experience working with LLM APIs and
  • Ability to design and execute structured, repeatable tests and capture sufficient metadata for reproducibility.
  • Understanding of system prompts, content filters, moderation layers, refusal behaviour and other safety controls that may affect evaluation results.
  • Proficiency working…
Para ver y solicitar empleos que acepten solicitudes de su ubicación o país, toque el botón a continuación para realizar una búsqueda.
(Si este trabajo está en su jurisdicción, entonces puede estar usando un Proxy o VPN para acceder a este sitio, para seguir avanzando, debe cambiar su conectividad a otro dispositivo móvil o PC).

Busque más trabajos aquí:

Buscar Trabajos
(Ingrese pocas palabras para obtener mejores resultados)
Nivel Educativo
Experiencia mínima requerida (años)
Publicado en los últimos:
Salario