Can't you just turn it off?.

Ideas that are perfectly true when applied to regular software but become harmfully false when applied to modern AIs