If you hold down the power button until the Power Off/Airplane Mode screen appears, you will see icons for Silent, Vibrate, and Sound On at the bottom.
I use the Volume Contol+ app, which I had to disable to make that work. Since the Volume Control+ app does so much more, I re-enabled it after this test.
