Sinead O'Connor ripping that pic of the pope. Probably doesn't qualify as 'best' but certainly is up there as momorable.
The Replacements were pretty awesome too.
Patti Smith doing Gloria is way way up there. Great great performance.
http://www.youtube.com/watch?v=7mIsN2JHPds