Cycling GPS on and off causing inaccurate location?

[Sweet Kitten Feet]

I only use my gps when I'm using navigation. All other times I turn it off. Sometimes I'll pull up a map at home (no gps signal inside house) and it'll pull my location from the tower which is horribly inaccurate for me. Like a mile off. Anyway when i go outside and turn gps back on it still gives me an inaccurate location. I downloaded GPS status and used that as a thread suggested that came up on a search.

But shouldn't the location pinpoint as soon as I turn the GPS setting on?