I would assume that this is controlled automatically, so the oldest stuff that is not needed is deleted from the card to make room for new stuff. The more stuff that is left on the card the better because moving stuff to the card is slow. Also, just because something is hidden in one frame does not mean it might not be shown again in the very next frame, so this sort of first in first out approach should really pay dividends performance wise.