At one time it was managed by Barnet Nathan, brother of the musician and 'friend of Byron' Isaac Nathan. Barnet, who was known professionally as 'Baron Nathan' (in mockery of Nathan Rothschild), was renowned for his act of dancing a hornpipe, blind-folded, across a stage laid out with eggs. On his death he merited an obituary in Punch.
The advent of the railways led to the Gardens' demise, as Londoners were now able to reach coastal resorts such as Margate and Southend.
It is referred to in Gilbert & Sullivan's comic opera "The Sorcerer" Act 2. Mr Wells sings "Hate me! I spend the day at ROSHERVILLE!"
It is also mentioned as a "place to spend a happy day" in chapter 13 of E. Nesbit's The Story of the Amulet.