They are all somewhat the same, yet at the same time quite different. Same thing here. ICS is the 4.0 version of Android, GB was 2.3 - much like newer versions of Windows, features are added; old bugs are fixed, and new bugs are introduced.
Newer is not ALWAYS better though, keep in mind that some places still use Windows XP, by choice. Most of its bugs are ironed out.