Yesterday When I Was Mad is a single from the album Very. It was written shorty after the "Performance Tour" due to the criticism the Pet Shop Boys received about their show.

It talks about the stresses of touring and some of the common comments people say to musicians. As well, Neil Tennant has stated that some of the lines of the song like, " And someone said it's fabulous you're still around today, you've both made such a little go a very long way" have actually happened.