It seems to me that fillrate, texture usage, etc. should have nothing to do with it. If I'm interpreting this correctly, turning on the portal system should simply stop certain objects from drawing.
Are you taking your FPS measurements from the same camera position? Can you post an example?
Are you taking your FPS measurements from the same camera position? Can you post an example?