An immigrant to the USA when young, he was brought up in the Bronx. He started in the record business in 1949, setting up Parody Records with his brother Sam.
His Old Town Records was active in the period from 1953 for over a decade. He was a producer of doo wop groups. Old Town had its first hit with the 1958 We Belong Together. Weiss was a practitioner of payola to get air play.
Weiss has a co-writer credit for the song "Foggy Notion" by the Velvet Underground, along with all of the members of the band.
Weiss was a resident of Rockleigh, New Jersey.