Wth your back against the wall

Where does "stand with your back against the wall" come from? I am told that it is from a time when the body of a church was used as a hall so all the chairs etc. were moved to the outside edge and you stood with your back against the wall.