Swap measure/column in a visual without losing underlying formatting

If a dataset gets updated with new column names then Power bi will give you an error message in the visual with the old name saying "This field was deleted from the model and can't be used in this visual."

You will now need to remove the old field and replace it with the updated field.

However, when you do that you lose all the custom adjustments that you made to that field. For example, I just swapped out the legend for a pie chart and my custom colors that I set up are now gone.

It would be great if we can swap the underlying field without actually removing it from the visual so that the formatting can remain the same.