TOPIC · ENGLISH EDITION
Research
Research ideas, benchmarks, documentation, and evaluation.
Benchmark Data Contamination
The presence of evaluation examples or closely related material in training data, potentially inflating benchmark results.
Data Provenance
Information about where data came from, how it was collected, and how it changed before use.
Datasheets for Datasets
A documentation framework for describing how datasets were created, composed, maintained, and intended to be used.
Foundation Model
A broadly trained model that can be adapted to many downstream tasks and applications.
HELM
Holistic Evaluation of Language Models, a framework for evaluating models across scenarios and metrics.
Hallucination in AI
A generated statement that is unsupported, fabricated, or inconsistent with the available evidence or context.
MMLU
Massive Multitask Language Understanding, a benchmark covering many academic and professional subject areas.
Model Card
A structured document that describes a model's intended use, evaluation, limitations, and other important context.
Red Teaming
Adversarial testing intended to discover failure modes, unsafe behavior, or exploitable weaknesses in an AI system.
Safety Evaluation
Testing designed to measure risks, harmful behaviors, and the effectiveness of safeguards in an AI system.
System Card
Documentation describing a deployed AI system, including capabilities, evaluations, mitigations, and limitations.