Are they all duplicated or just certain apps? e.g. If you have both 2.0.1 and 2.1 Gallery installed then you will have two Gallery icons. The only way to remove one would be to uninstall the app you don't want (you must be rooted to get rid of any stock 2.0.1 apps).