Mt. Olivet Chapel is the oldest standing structure in Pineville. During the Civil War, the chapel was used as headquarters for the Union Army, and was therefore spared from the burning of Alexandria. The Cemetery is the second oldest in the area. The names of early pioneers and prominent citizens of the area can be found on the tombstones.