you can safely remove them. All java updates are stand alone and can be installed on their on.

Why Sun doesn't remove the previous versions on updating is based upon anyones guess...They just don't do it and have no intentions of providing an uninstaller for the previous versions.