SEARCH · ENGLISH EDITION
Find an AI concept.
Search titles, summaries, article text, source-language titles, and known aliases.
EN
GPU
A highly parallel processor widely used to train and run modern machine-learning models.
EN
Inference
The process of running a trained model on new input to produce predictions, embeddings, or generated output.
EN
KV Cache
A cache of attention keys and values used to avoid recomputing earlier context during autoregressive generation.
EN
Knowledge Distillation
A training method in which a smaller student model learns from the outputs or representations of a larger teacher model.
EN
Latency and Throughput
Two core serving metrics describing response delay and the amount of work a system completes over time.