Do You Need To Take Off Your Headphones At A TSA Checkpoint?

Plenty of people wear headphones right up to the TSA checkpoint, but is that actually allowed? Here's what the rules say and what agents expect.