Infinite loop

Just buy one of those brooms that have the vacuum. It helps if you have a bad back or knees too.

Everytime you sweep more, you only sweep half. And half of that... And half of that..
Forever.

Turn the dustpan perpendicular to the line. Sweep it in. Repeat as needed.

I find that this happens only with a brush. In Nigeria we have brooms made from the midrib of palm leaves. This doesn't happen when I sweep with those.