ORBiS Tree

SEARCH · ENGLISH EDITION

Find an AI concept.

Search titles, summaries, article text, source-language titles, and known aliases.

Results for “Inference”
EN

AI Memory

Stored conversation state, preferences and task records, distinguished from context windows and model training, with examples of freshness and access boundaries.

EN

Claude

A family of general-purpose AI models and conversational products developed by Anthropic.

EN

Context Window

The amount of tokenized input and generated text a model can consider within one inference context.

EN

Embedding

A numerical vector representation used to encode semantic or structural properties of data.

EN

GPT

Generative Pre-trained Transformer, a family of autoregressive language models associated with OpenAI.

EN

GPT-6 Astra

An OpenAI GPT-family model described for complex reasoning, coding, research and tool-based work, with a practical framework for task-level evaluation.

EN

GPU

A highly parallel processor widely used to train and run modern machine-learning models.

EN

HELM

Holistic Evaluation of Language Models, a framework for evaluating models across scenarios and metrics.

EN

Hallucination in AI

A generated statement that is unsupported, fabricated, or inconsistent with the available evidence or context.

EN

Inference

The process of running a trained model on new input to produce predictions, embeddings, or generated output.

EN

KV Cache

A cache of attention keys and values used to avoid recomputing earlier context during autoregressive generation.

EN

Knowledge Distillation

A training method in which a smaller student model learns from the outputs or representations of a larger teacher model.

EN

Latency and Throughput

Two core serving metrics describing response delay and the amount of work a system completes over time.

EN

Mistral AI

An AI company providing models and inference services, with a guide to model-specific licenses, hosted versus self-operated deployment and task-level comparison.

EN

Mixture of Experts (MoE)

A model architecture that routes each input to a subset of specialized parameter blocks called experts.

EN

Multimodal AI

AI systems that process or generate more than one type of data, such as text, images, audio, or video.

EN

OpenAI

An artificial intelligence research and deployment organization known for GPT models and ChatGPT.

EN

Project Suncatcher

Google Research's exploration of AI computing in space, with solar power, accelerators and optical links examined as a research system.

EN

Quantization

A technique that represents model weights or activations with lower numerical precision to reduce resource use.

EN

Sovereign AI

Control over AI data, infrastructure, models and operational capabilities, examined separately from data location and supplier branding.

EN

Tensor Processing Unit (TPU)

Google's specialized machine-learning accelerator, explained through matrix computation, software compatibility and workload-level evaluation.

EN

Tokenization

The process of converting text or other input into discrete units that a model can process.