Adversarial Swamp

From The Transhumanist Wiki
Jump to: navigation, search

From the SL4 Lexicon:

Adversarial Swamp:

The swamp of AI inhibitions and meta-inhibitions, and programmer fears and anxieties, resulting from the Adversarial Attitude or the use of Asimov Laws. To enforce even a single feature that is not consistent with the rest of the AI - to use, as a feature of Friendliness, something that you perceive as an error on the AI's part - you'd need not only the error/feature, but inhibitions to protect the error, and meta-inhibitions to protect the inhibitions, and more inhibitions to cut the AI short every time ve tries for a new avenue of philosophical sophistication. Stupid and simple cognitive processes suddenly become preferable, since every trace of complexity - of ability - becomes a danger to be feared... this is the Adversarial Swamp, which inevitably drags down all who set foot in it; once you try to enforce even a single feature, the whole of the AI becomes a threat, and the programmers are forever doomed to swim against the current Yudkowsky01.

Personal tools
Namespaces
Variants
Actions
Content Navigation
Network
Community
Toolbox