Actually found a bug in the new ics alarm - after it went off this morning, I tapped the screen to snooze and it kept going off. I then tapped it a few extra times and noticed the popup gone. I no way to stop the alarm except for rebooting.
If you tap somewhere not on the popup button it seems to keep going off but the buttons disappear... you can bring them back by clicking on the notification though.