Why must the fuse/switch/circuit breaker be connected to the live wire?

The live wire is at high voltage, and carries the current from the electrical mains to the electrical appliance. If any electric fault occurs, resulting in high current flow, the fuse/switch/circuit breaker on the live wire will immediately cut off the high current/high voltage before the high current/voltage can cause damage to the electrical wirings and the appliance.