I followed this tutorial, and everything went according to plan. I have root access, etc.
I installed SetCPU from the market... and am not able to overclock beyond 550mhz.
Will I need a custom ROM to overclock to 800? I am quite happy with my current setup, just wanted to give the overclocking a shot. Not really wanting to install a custom ROM if I can avoid it.