Maybe the collisions are causing the anomalies ? For instance a sliding collision that is barely noticable, but does affect the rotation of the source entity somehow. On the other hand, collisions should only affect X/Y/Z. Still, after resetting the Pitch/Yaw to zero, try using ResetEntity.