One of the first recordings was in 1937, by Chick Webb and his Orchestra with vocal by Louis Jordan. A (very) brief MP3 excerpt can be heard here
"Gee, But You're Swell" was adopted by Australian television performer Graham Kennedy as his theme song for In Melbourne Tonight.