Ethical Injunction

From the SL4 Lexicon:

Ethical Injunction:

In Friendly AI theory, a cooperative safeguard between programmers and an in-progress AI, to prevent the AI from taking actions that neither the AI nor the programmer want (such as the AI rewriting itself to be unFriendly.) Exists not as an absolute rule, but because the probability of mistaken violation is greater than the probability of correct violation Yudkowsky01. See also Friendship Architecture.