Go here and get MoveOnBoot, then install it. Right mouse click on the Firefox icon, and click on the square icon with a a X in it Delete file(s) on next reboot.
Then restart your computer and the FF icon will be gone...
Download MoveOnBoot 1.95 - Allows you to copy, moves or delete files on the next system boot - Softpedia