Try here: Only set a single tag in Picard (complete $unset tag list)
It points to how to not update tags\fields so you can only change a single one. You set a list up of “do not change these tags” to then freeze the values.
Or use MP3TAG to manipulate just specific tags.