SEARCH · ENGLISH EDITION
Find an AI concept.
Search titles, summaries, article text, source-language titles, and known aliases.
AI Agent Oversight
Human control over agent goals, tool permissions, execution and outcomes, including meaningful reviews and recovery from failures.
AI Alignment
Research and design for relating AI behavior to human intentions, values and constraints, including reward proxies, feedback and operational evaluation.
Anthropic
An AI company that develops the Claude model and product family and conducts AI safety research.
Claude
A family of general-purpose AI models and conversational products developed by Anthropic.
RLHF
Reinforcement Learning from Human Feedback, a method for aligning model behavior with human preferences.
Red Teaming
Adversarial testing intended to discover failure modes, unsafe behavior, or exploitable weaknesses in an AI system.
Safety Evaluation
Testing designed to measure risks, harmful behaviors, and the effectiveness of safeguards in an AI system.
System Card
Documentation describing a deployed AI system, including capabilities, evaluations, mitigations, and limitations.