Max IDE - Window Icon

A single .ico file can contain icons of varying colours depths and sizes.

There are a few free icon editors about (google for 'snidesoft') that will help you put the icons into one .ico file.