Elephant in the room.

What's the origin of that phrase. Does it have to do the little white elephant statues that I sometimes see in peoples' houses? They say it's suppose too face opposite the entrance door for luck.