Control the enable/disable of drill through at visual level

On PBI desktop, when drill through is enabled via right click, currently there is not a direct way to control if we want to show the drill through on some visuals, while not show it on some other visuals. Could we make some change in PBI, to add an attribute at visual level, to control if we want to show / hide drill through? 



The reason to ask is, for any metrics been added to drill through, all visuals will show drill through when right click. We have table visual and scorecard visual which touches the same metric, and we only want to show drill through on table visual. So far we didn't find a good way to do this. 



One tricky way is to create duplicate metrics, but this is not sustainable since with more and more metrics been added, it is hard to maintain.,