Phish were the musical guests on The Late Show with David Letterman.