I think the easiest way is to control all actors manually then record your actions, then replay them parallely. Finally the user may control the camera while the actors/objects replay the recorderd actions. I'd suggest to use t fixed framerate to keep things simple, eg. 30 fps.