I want to uninstall Outlook on the Desktop, but it complains that it's running.

To uninstall, you have to first close the program. To do that: Right Click on the tray icon for Outlook on the Desktop (the small white icon with the day of the month on it in the bottom right corner of your screen) and click "Exit" You can then proceed with the uninstall from Add/Remove Programs.