I’m pretty sure the term jailbreak comes from the term “jail” being used on FreeBSD, which iOS is based on, which is an application sandboxing tool, therefore, a “jailbreak” is a method to escape that sandbox and gain elevated permissions to the system.

iOS being a jail is a pretty apt analogy, regardless, though.