Language model benchmark

Wikimedia list article

Texto em inglês

Na Wikipédia

Texto em inglês Ainda não há artigo no seu idioma: trecho em inglês.

A language model benchmark is a standardized test designed to evaluate the performance of language models on various natural language processing tasks. These tests are intended for comparing different models' capabilities in areas such as language understanding, generation, and reasoning. Benchmarks generally consist of a dataset and corresponding evaluation metrics. The dataset provides text samples and annotations, while the metrics measure a model's performance on tasks like answering questions, text classification, and machine translation. These benchmarks are developed and maintained by academic institutions, research organizations, and industry players to track progress in the field. In addition to accuracy, the metrics can include throughput, energy efficiency, bias, trust, and sustainability.

Texto: Wikipédia em inglês, CC BY-SA 4.0. ·

Cartas próximas

LLM-as-a-Judge

Use of large language models as automated evaluators

Nº Q134468621 ★

Sem ofertas
M

MMLU

Language understanding across multiple domains

Nº Q123721276 ★

Sem ofertas
EF Standard English Test

Standardized test of English language for non-native speakers

Nº Q19894858 ★

Sem ofertas
Topic model

Type of model

Nº Q3532085 ★

Sem ofertas
L

Linguagem de modelagem

Nº Q1941921 ★

Sem ofertas
Geração de linguagem natural

Nº Q1513879 ★

Sem ofertas

Carregar mais