← К другим вакансиям
Thomson Reuters

Senior Research Engineer, Model Evaluations

Hybrid • London, United Kingdom • Senior • Не указана
Зарплата
Не указана
Опубликовано
14 ч назад
Описание

Job Description

Thomson Reuters Labs builds and ships custom models for professional workflows requiring fiduciary-grade AI. The Thomson LLM family was developed by training leading open-weight models on decades of authoritative Thomson Reuters content, with thousands of hours of subject-matter-expert input. Owning the model layer is how we earn trust in the most regulated, highest-stakes professional workflows.

See the detailed technical report for more information on the latest model release: Thomson 1.0 Technical Report on Hugging Face.

The evaluation team focuses on providing signal for model development and adoption using a combination of benchmarks and targeted evaluations to assess performance on highly complex legal and professional workflows. The team works with legal experts to adapt their expertise into benchmarks and with product leaders to ensure model capabilities are aligned with real, user-facing flows in professional work.

As a research engineer on the team, you would be working with researchers to design, develop, optimize and scale the evaluation suite as Thomson scales to newer releases and product integrations. You’ll work in cutting edge areas of AI development, such as multi-agent systems and decision models to keep the Thomson model suite at the frontier of specialized professional LLMs.

Key Responsibilities

  • Build and operate the evaluation suite that runs Thomson evaluations
  • Design and develop the platform to scale as the scale of evaluations grow
  • Implement and tune optimization techniques to reduce cost and latency without sacrificing quality.
  • Contribute to the work needed for a production footing: contribute to the team’s ISO 27001 compliance path
  • Work directly with the evaluation pod to get new model releases evaluated and live on the leaderboard.

Required Qualifications

  • Hands-on research engineering experience in evaluations – with examples of building, scaling and optimizing evaluations suites and what impact your work had
  • Experience working closely with researchers and cross-functional stakeholders to translate research ideas and requirements...

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.

Sed ut perspiciatis unde omnis iste natus error sit voluptatem accusantium doloremque laudantium, totam rem aperiam, eaque ipsa quae ab illo inventore veritatis.

Хочешь прочитать весь текст вакансии?
Авторизуйся за пару секунд, чтобы получить полный доступ к описаниям и откликам.
Войти через Telegram