Libxml compiling, again and again...

Since libxml is a module it shouldn't be recompiled even without quick build, should it?