Fading

draw the stuff to a texture you apply to a sprite. Then you can fade that sprite, which allow you to fade any part of the screen as long it was an own sprite.

SetGamma is meant for gamma, not for fading, actually.