Texture & Brush handles

Is it a good practice to free any brush/texture handles after applying on entities?
I am asking because the only reason I can see not to destroy them is when I have animated textures or brushes created by animated textures.

Thanks!