In the Regency, they had a bone and rag collector, but no need for dust bins.
Without the manufactured substances we have today, remnants from daily life could be burned in the household stove.
Comparatively, as far as history is concerned, dust bins are a modern invention. And recycling—it's probably as old as humanity.