With increased interest in the music from local, national, and international magazines and the EP selling in 5 continents, in 2003 Bryce recorded and released his debut album Calendar Days. The album title comes from a line in the song "TV Family". Using a $15,000 budget, the album was recorded in Kansas on the label The Militia Group. The album was critically praised as being extremely uplifting, and included varied music (for example, a track including a 6th grade choir that his younger sister was in from Texas). The album sold well throughout the United States and Japan and went bronze in 2005.
In November 2004, Bryce began working with producer Tim O'Heir in Brooklyn to record his second album Hello, Good Friend - the album title coming from the song "Never Knew". This album included more piano central songs than his previous album. The Rocket Summer has toured the US and Japan extensively and has gained a large fan base. The album was subsequently released by a Christian music label to Christian retail outlets. Although it is not immediately obvious in his lyrics, Avary is a Christian and lets his faith influence his lyrics and his music.
He signed with Island Def Jam Records for his third record, Do You Feel, which was released on July 17th, 2007. The first single from the album is So Much Love. The Rocket Summer has released the music video for So Much Love. On September 5th, 2008, the music video for Do You Feel was released. On May 16th, the song "Break It Out", from Do You Feel was added to the TRS website and Myspace. Also, tracks such as "Do You Feel" and "So In This Hour", after being included on a CD Sampler, and "Save" have been leaked online. On July 11, the entire album was leaked online.
The Rocket Summer toured with the Vans Warped Tour in the summer of 2007 for two months. Although Bryce records all of his own instruments for his records, he tours with a band mostly made up of high school friends. His band currently consists of Seth Brewton on guitar, Matt Bergeland on bass, and Tommy Quinn on drums. His wife, Tara, tours with him as his business manager and sells merchandise at his shows.
When asked what he would do if he weren't a musician, he replied, "I'm deathly afraid of 'not' doing this because I have no idea what I would."
In January 27, 2008, The Rocket Summer played a series of dates in the UK including major cities such as London, Manchester, Newcastle and Cardiff, with The Secret Handshake and Between the Trees supporting. Before The Rocket Summer's set every night, Jamie Tworkowski spoke briefly about To Write Love On Her Arms.
Beginning March 14, 2008, The Rocket Summer co-headlined the Alternative Press tour. It started in Houston, Texas and ended in May in Cleveland, Ohio. Also co-headlining was All Time Low, with The Matches, Sonny, and Forever The Sickest Kids supporting - Live Photos from AP Tour
It has been revealed that The Rocket Summer will be returning to the United States for a headlining fall tour. According to a video blog posted by Bryce Avary on June 4, 2008, The Secret Handshake, Phantom Planet and The Morning Light will be supporting The Rocket Summer for the fall tour in the United States. Dates for this tour are currently available on The Rocket Summer's website. In the mean time between tours, Bryce Avary has stated that he will be writing and recording new songs.