SEARCH · ENGLISH EDITION
Find an AI concept.
Search titles, summaries, article text, source-language titles, and known aliases.
BERT
Bidirectional Encoder Representations from Transformers, an encoder-based language representation model.
Embedding
A numerical vector representation used to encode semantic or structural properties of data.
Fine-tuning
Additional training that adapts a pre-trained model to a narrower task, domain, or behavior.
Foundation Model
A broadly trained model that can be adapted to many downstream tasks and applications.
GPT
Generative Pre-trained Transformer, a family of autoregressive language models associated with OpenAI.
Knowledge Distillation
A training method in which a smaller student model learns from the outputs or representations of a larger teacher model.
Large Language Model (LLM)
A general-purpose language model trained on large datasets and usually built at substantial scale.
Mistral AI
An AI company providing models and inference services, with a guide to model-specific licenses, hosted versus self-operated deployment and task-level comparison.
Model Card
A structured document that describes a model's intended use, evaluation, limitations, and other important context.
Quantization
A technique that represents model weights or activations with lower numerical precision to reduce resource use.
Sovereign AI
Control over AI data, infrastructure, models and operational capabilities, examined separately from data location and supplier branding.
Tokenization
The process of converting text or other input into discrete units that a model can process.
Transformer
A neural network architecture that processes sequences primarily through attention mechanisms.