It showed error message and had to Forced close on it, tried to reboot a few times but still not working.
Forced close on voice search too. Should I wait to see or bring it back to exchange?
Sometimes the screen open in opposite orientation and freeze.

Sounds like you are having numerous problems and that shouldn't be with a brand new phone.

Bring it back to Verizon and duplicate the issues for them and they should happily exchange it for you.