Throw the rascals out!

This is an old US phrase that often reemerges around election time. It is based on the strategy that whoever has been in power has been corrupted, and we should just throw them out and put in a new lot. Not a bad idea, generally!

I've heard "vote the bum(s) out".

"Rascal" isn't much of an insult these days. I think that's a pretty old expression, from a time when being called a "rascal" must've been pretty bad.