Yes collisions slow your game down! There are a few solutions. For one you can use invisible lower polygon collision instead of polygon collision depending on how many polys you're using. Of course you're also using 40,000 types! Perhaps you're just learning?