The actual location of the fort in the film was the historic Castillo de San Marcos.
The enduring legacy of this movie is the earliest known use of the Wilhelm scream sound effect, originally used to vocalize a character being torn to pieces by an alligator.
The title of Pedro Almodovar's film Tacones lejanos (literally "Distant Heels" but released as High Heels) is a reference to the Spanish title of this film (Tambores lejanos).
Distant Drums is also a song sung by Jim Reeves in 1966 and a song recorded by Roy Orbison in 1963.