Harpers Ferry was right on the boundary between the Union and Confederate forces. Both sides wanted the Federal Armory here in Harpers Ferry. This town changed hands between the Union forces and the Confederates no less than eight times during the war.