Instrumental convergence
Hypothetical tendency for sufficiently intelligent agents to pursue unbounded instrumental goals such as self-preservation and resource acquisition
Instrumental convergence is the hypothesis that sufficiently intelligent, goal-directed entities (whether human or non-human) will tend to pursue certain similar sub-goals, even if the ultimate goals are quite different. More precisely, entities with agency may pursue instrumental goals—specifically, intermediate goals such as self-preservation or resource acquisition—because doing so helps accomplish the entity's end goal.
Nº Q18208100 ★★★
Rare · Knowledge
Instrumental convergence
Hypothetical tendency for sufficiently intelligent agents to pursue unbounded instrumental goals such as self-preservation and resource acquisition
Instrumental convergence is the hypothesis that sufficiently intelligent, goal-directed entities (whether human or non-human) will tend to pursue certain similar sub-goals, even if the ultimate goals are quite different. More precisely, entities with agency may pursue instrumental goals—specifically, intermediate goals such as self-preservation or resource acquisition—because doing so helps accomplish the entity's end goal.
Last price
—
Floor price
—
7-day median
—
30-day sales
0
30-day range
—
In circulation
0
Price history
median
low – high
sales
No sales in this period
Show table
| Date | median | Low | High | sales |
|---|
Sales history
- Last sale
- —
- 30-day average
- —
- 30-day low
- —
- 30-day high
- —
- Sales 7d
- 0
- Sales 30d
- 0
No sales yet.
Anonymous sales: no buyer or seller shown. Figures count player-to-player sales only.
From Wikipedia
Instrumental convergence is the hypothesis that sufficiently intelligent, goal-directed entities (whether human or non-human) will tend to pursue certain similar sub-goals, even if the ultimate goals are quite different. More precisely, entities with agency may pursue instrumental goals—specifically, intermediate goals such as self-preservation or resource acquisition—because doing so helps accomplish the entity's end goal. Instrumental convergence implies that when assigned an unbounded end goal, an intelligent agent can act in unanticipated ways that are very harmful. For example, a sufficiently intelligent program with the sole, unconstrained goal of solving a highly complex mathematics problem could (as an intermediary step) attempt to transform the entire Earth into additional computing infrastructure as a resource to power its calculations.
Text: Wikipédia, CC BY-SA 4.0. ·
Related cards
Technological singularity
Hypothetic future event in which artificial intelligence iteratively redesigns itself to rapidly become more intelligent, causing technological and social change beyond prediction
Nº Q237525 ★★★★
Just intonation
Musical tuning based on pure intervals
Nº Q752518 ★★★
Superintelligence
Hypothetical agent that possesses intelligence far surpassing that of the brightest and most gifted human minds
Nº Q1566000 ★★★
AI alignment
Alignment of AI systems towards human goals, preferences and ethical principles
Nº Q24882728 ★★★★
Swarm intelligence
Collective behavior of decentralized, self-organized systems
Nº Q863960 ★★
SMART criteria
Mnemonic for a goal-setting criteria, which stands for: specific, measurable, achievable (or attainable), relevant, and time-bound
Nº Q967017 ★★★★