Nope that's something I've never had to do. I use the mouse wheel every single time I have ever found a backpack I want to pick up. Roll it to pick up bag and click, voila new bag. Works every single time without having to clear away any other objects.
