"I think the real hard thing is to match the light of the 3D models with the actual movie footage. "
I think they use 2 spheres on the end of sticks during filming - one is mirrored and the other neutral grey. Don't ask me how this translates to lighting information, best to ask Google.