but how much of a slowdown does rotating 0 degrees take?
Exactly the same as rotating to any other angle. You could just add to the rotation component of rendering the image to check if rotation = 0 then skip the rotation algorithm.
I'd wager that its faster to simply force the rotation rather than doing a comparison first.