Emergent Abilities
Category: Emerging Concepts
Category: Emerging Concepts
Definition
Emergent abilities are capabilities that appear suddenly in AI models as they reach certain scales, without being explicitly programmed or predictable from smaller versions.
How It Works
Small models struggle with tasks like arithmetic or reasoning, showing near-zero performance. But at certain size thresholds, these abilities suddenly emerge, jumping from failure to competence.
These phase transitions surprise even researchers who built the models.
Why It Matters
Emergent abilities suggest we don't fully understand what large models can do until we build them. Each scale increase might unlock unexpected capabilities.
This unpredictability makes AI development both exciting and concerning for safety researchers.
← Back to Emerging Concepts | All Terms