SEARCH · ENGLISH EDITION
Find an AI concept.
Search titles, summaries, article text, source-language titles, and known aliases.
BERT
Bidirectional Encoder Representations from Transformers, an encoder-based language representation model.
Fine-tuning
Additional training that adapts a pre-trained model to a narrower task, domain, or behavior.
Foundation Model
A broadly trained model that can be adapted to many downstream tasks and applications.
GPT
Generative Pre-trained Transformer, a family of autoregressive language models associated with OpenAI.
Knowledge Distillation
A training method in which a smaller student model learns from the outputs or representations of a larger teacher model.
Large Language Model (LLM)
A general-purpose language model trained on large datasets and usually built at substantial scale.
LoRA
Low-Rank Adaptation, a parameter-efficient technique for adapting large neural networks.
RLHF
Reinforcement Learning from Human Feedback, a method for aligning model behavior with human preferences.
Retrieval-Augmented Generation (RAG)
A method that retrieves external information and supplies it to a generative model as context.