This drove me nuts for a while until I figured out the workaround:

Expand down to a specific item. Click the item number to open the "last choice for quantity and stuff before adding to cart" dropdown. In this, rightclick "Item Detail" and open in new tab.

Now in the new tab, head to the top right, "view catalog page", and you're back to the category.

I agree that it's a weakness, though.