The band recorded two shows with the orchestra on May 12, 1995 and May 13, 1995. The shows included several renditions of the band's best known songs, and an entire album's worth of songs written specifically for the symphony shows. The new songs were compiled on the album Open Heart Symphony; several of the hits performed at the shows appear on the band's 1999 compilation Hit Parade.
A studio version of "Kiss and Tell" appeared on the 1997 soundtrack album to the film The Hanging Garden. "Let the Ass Bray" was reportedly written after Mann and Kelly attended a Radiohead concert at which Thom Yorke angrily refused an audience member's request to play "Creep" even though it was Radiohead's only notable hit single at the time.