Baker and Cardwell had both been members of The Geeks, formed in early 1977 with Ross Buncle on guitar and a vocalist known as Lloyd. That band folded when Baker and Cardwell left to form The Victims with Faulkner, who then referred to himself as Dave Flick. The Geeks' repertoire of original songs formed the core of the Victims' initial repertoire.
In 1977, The Victims released their debut single, "Television Addict" (Faulkner/Baker)/"I'm Flipped Out Over You" (Baker/Buncle), of which only 1,000 copies were pressed. The following year they released an EP entitled simply The Victims (also known as No Thanks to the Human Turd), which included five tracks: "I Understand", "Open Your Eyes", "TV Freak", "High School Girls" and "Disco Junkies". Baker was one of the writers of these songs; the identity of his co-composer is disputed, with some sources claiming that it was Faulkner and others Buncle. Only 500 copies of the EP were released.
In 1989, a compilation album, All Loud on the Western Front was released. It included all the songs from their single and EP, as well as "Perth is a Culture Shock". The album was re-issued on CD in 2005.
"Television Addict" has been recorded by Hoodoo Gurus, You Am I, The Hellacopters and Teengenerate. It is also a mainstay of Australian punk compilations. The song was also played live by US band The Bronx on their 2007 Australian tour.