How to Delete iPhone Apps Stuck on Installing Updates

Updating apps on our iPhones and iPads should be an easy and simple process, and it usually is. When an app gets stuck part way through installing, however, it's frustrating because you're trapped in an endless loop and trying to reinstall typically doesn't help, plus doing the tap-and-hold trick to delete the app doesn't work, either. There is a fix, although it certainly isn't obvious.