From 1901 to 1904, the first great Los Angeles boxing promoter, Uncle Tom McCarey, staged his first boxing shows at the pavilion. It would be McCarey who put the Los Angeles area on the map as a major boxing venue. Many famous boxers fought at the Pavilion. The future World Heavyweight Champion, Jim Jeffries, had only one fully recorded bout in Los Angeles, his hometown, when he fought Joe Goddard there in 1898. The man who would go on to be the first World Heavyweight Champion, Jack Johnson, fought in eight main events on cards staged by Tom McCarey at the pavilion during a period from 1902 to 1904. Other famous fighters who had bouts at Hazard's Pavilion include Kid McCoy, Joe Walcott, Dixie Kid, Sam McVey, Solly Smith, Frankie Neil, Denver Ed Martin, Hank Griffin, Frank Childs, Al Neill, Joe Bernstein, and Billy Woods.
In 1892, James J. Corbett fought in an exhibition bout with his sparring partner, Jim Daly at Hazard's Pavilion. Later in the same year, Corbett would go on to win the World Heavyweight Title from the then-champion, John L. Sullivan. Also at the pavilion, Ex-World Heavyweight Bob Fitzsimmons had one exhibition bout while Jim Jeffries had two, one of them as the World Heavyweight Champion.
In late 1904, the Temple Baptist Church leased the pavilion, changing its name to Temple Auditorium, at a time when churches were generally opposed to professional boxing. As a result, Tom McCarey was forced to find another venue for his boxing shows, a tough proposition because the site could not be located near residential areas, but it also had to be located near trolley lines. It would be late 1905 when McCarey staged his first card at a new pavilion located on North Main Street in the Naud Junction area.
In 1906, Hazard's Pavilion was demolished to make way for a new Temple Auditorium. The architect, Charles E. Whittlesey, and civil engineer, C. R. Harris, created a building with a Spanish Gothic exterior and a vast auditorium with a simplified Art-Nouveau interior influenced by Louis Sullivan's Chicago Auditorium. This was the largest reinforced concrete structure with the only cantilevered balcony in the world. It had the largest stage west of New York when it was completed, and it seated 2,600 people. A nine story office block and retail shops were part of the complex.
For a number of years during the 1910s, Billy Clune would show silent films in the auditorium, then called, "Clune's Auditorium. The landmark film, Birth of a Nation, had its world premiere at Clune's Auditorium on its way to becoming a massive blockbuster.