Filtering in Matrix with Drilldown - filter based on current view hierarchy

In a matrix with drilldowns, setting visual filter options affects the data that is being shown at the deepest level. I would love to have the filter act on data at the smallest level of the hierarchy currently being viewed.

For example, if my row hierarchy is:
Category/Subcategory/Product

And i set a visual filter where Sales > 5,000

If I am only viewing at the Category level, it should filter based off of total sales for each category. If I am viewing subcategory as the deepest level, it woudl filter where subcategory sales are > 5000.

Currently, regardless of what level of the hierarchy you are viewing, it will filter at the deepest level. For example, if I am viewing only Category, and I set the filter to Sales > 5000, it will only show me categories that have a PRODUCT that has sales > 5000. This is slightly misleading and confusing.