Round ViewPort... or something like this

I'd do what Beaker says: going for Stencil Buffers.
In fact I've been getting some info on how they work, and can be very useful for these things among others