They released their first mini-album, Soon There Will Be..., on Too Pure Records, on 17th October 2005. The second, "Yes! Tinnitus!" was released on May 22nd 2006 - however, Chapple has since moved to Melbourne, Australia for two years (the band played their last gig in the Northern Hemisphere on April 16th 2006 at Cardiff's Clwb Ifor Bach, where Chapple also sold most of his books, videos and some of his records). After emigrating, Chapple assembled the first Australian incarnation of the band with members of the bands The Cheats and Riff Random - Tom Cooper and Julian Tovey. Chapple hinted at the possibility of maintaining two distinct versions of the band in order to play shows on both continents. During October 2006, the band played a weekly residency at the Tote in Melbourne, played at the Melbourne show in the Big Day Out festival in January 2007 and continue to be an active part of the local music scene.
The band released their third album Triptych - a 3 disc record - on August 11, 2007, after which the first with Australian line-up was dissolved. Their replacements were Richmond Brain (also in Catnip) and Chris Drane (also in A Friend Of Mine).