the shadow projection seems correct as long as the shadow light stays at the position of the shadow receiver....
Exactly! You are rendering from the light position right? So it will only look correct when the light is at the same position as the receiver.