Isn't the whole shader stuff optional
No. I was wondering the same jfk, or why not use a shader that uses older features?
SM3 is simply more elegant. The most obvious advantages are dynamic branching and long (more than) 96 instructions for pixel shaders.