Yes, it would be frowned upon. It is my understanding that the audio in the SACD layer of a hybrid SACD is often demonstrably different from the CD layer (5.1 mix vs. 2-channel mix IIRC). When tagging files in Picard you can manually move them to whichever position on the disc is correct.