I wasn't talking about the icons, the buttons to minimize/restore the windows were appearing twice. But, I uninstalled Notebook Hardware Control and it has stopped happening. I think it may have been causing problems with the language toolbar, since the extra set of buttons was appearing were the language toolbar was supposed to be.