SEARCH · ENGLISH EDITION
Find an AI concept.
Search titles, summaries, article text, source-language titles, and known aliases.
Attention
A mechanism that lets a neural network weigh the relevance of different positions when computing a representation.
BERT
Bidirectional Encoder Representations from Transformers, an encoder-based language representation model.
GPT
Generative Pre-trained Transformer, a family of autoregressive language models associated with OpenAI.
Google DeepMind
Google's AI research organization, formed from the combination of DeepMind and Google Brain teams.
KV Cache
A cache of attention keys and values used to avoid recomputing earlier context during autoregressive generation.
Large Language Model (LLM)
A general-purpose language model trained on large datasets and usually built at substantial scale.
Multimodal AI
AI systems that process or generate more than one type of data, such as text, images, audio, or video.
Transformer
A neural network architecture that processes sequences primarily through attention mechanisms.