Fits where it touches

Having a discussion at the weekend about the phrase "Fits where it touches" in relation to clothing. I thought it meant the item was too big but my friend thought it meant the clothing was too tight. Who was correct?