ORBiS Tree

SEARCH · ENGLISH EDITION

Find an AI concept.

Search titles, summaries, article text, source-language titles, and known aliases.

Results for “Quantization”
EN

Fine-tuning

Additional training that adapts a pre-trained model to a narrower task, domain, or behavior.

EN

GPU

A highly parallel processor widely used to train and run modern machine-learning models.

EN

Inference

The process of running a trained model on new input to produce predictions, embeddings, or generated output.

EN

KV Cache

A cache of attention keys and values used to avoid recomputing earlier context during autoregressive generation.

EN

Knowledge Distillation

A training method in which a smaller student model learns from the outputs or representations of a larger teacher model.

EN

LoRA

Low-Rank Adaptation, a parameter-efficient technique for adapting large neural networks.

EN

Mistral AI

An AI company providing models and inference services, with a guide to model-specific licenses, hosted versus self-operated deployment and task-level comparison.

EN

Mixture of Experts (MoE)

A model architecture that routes each input to a subset of specialized parameter blocks called experts.

EN

Quantization

A technique that represents model weights or activations with lower numerical precision to reduce resource use.

EN

Sovereign AI

Control over AI data, infrastructure, models and operational capabilities, examined separately from data location and supplier branding.