Off with the old, on with the new

Does anyone know where this idiom comes from? And what do "the old" and "the new" refer to?