Flashing multiple times - Does it matter?

I think I read that you can flash back and forth. I know you can as I’ve done it 3 times from XS0X to XSU1. Is their any possibility of screwing up the firmware even when the flashes say success?

It seems to happen in very few cases, but then, you can simply flash again.