Morris Dancers

Quite often you'll hear ...

'Pull the other one, it's got bells on'

I have a sneaking suspicion that this derives from English Morris dancers, who wear bells on their ankles. One of the charachters is the village idiot, so maybe the third party is claiming to be a Morris dancer, not the idiot ( i.e. you trying to fool the wrong person)