What's wrong with my collisions?

I don't think I understand your problem properly, as I don't see how scaling the level mesh will help. Maybe simply zooming the camera in a bit will help?

Anyway, if you think you have a solution, give it a try. :)