Many 19th century influential African-Americans were buried in the cemetery, including Reverend Elias Dibble, first minister of Trinity United Methodist Church; Reverend Wade H. Logan, also a minister of the church; and James Kyle, a blacksmith; as well as Richard Brock.
The cemetery includes more than 700 family plots around a graceful, elliptical drive that originated at an ornate entry gate. It contains graves of both the well-to-do and those who died in poverty; therefore, the grave markers run the gamut from elaborate Victorian monuments to simple, handmade headstones. Burials at Olivewood Cemetery continued through the 1960s.
In 2003, after decades of neglect and abandonment, the "Decedents of Olivewood," a nonprofit organization, was established to take guardianship of the cemetery, "to provide care and to protect its historical significance." The group has also been working to have Olivewood designated an Historic Texas Cemetery.
Cathi Bunn, a paranormal investigator, began exploring Olivewood in 1999. One moonlit midnight, Bunn said she videotaped the ghost of Mary White, who was buried in 1888, hovering above her headstone.