Siding up

What is the origin of the saying 'siding up', meaning clearing the table after a meal?