Yes, it is an ICS thing. It appears whenever the keyboard is active and replaces the long press on a text field to bring up the text input method. With it in the notification area, if you want to change your input method, you pull down your drop down, select the keyboard and then you can change your keyboard/input method. Although, not that big of a difference, I find it pretty convenient because it doesn't interfere with what I'm typing.