Skunk at the garden party

"To be the skunk at the garden party"
I know that it means to be the unwanted guest at a party, It could be someone who crashes a party. I would like to know the origin of this expression.

Replies