The time paradox: how your brain creates the fourth dimension

We all feel that time goes faster when we're having fun, and drags when we're bored, but there is nothing in physics that describes this effect. So how has our sense of time evolved?