It took me a while but i figured it out. If you press and hold on the icon. you can then move it as you have figured out. what i didn't notice right away is at the bottom where the Grey tab is, that Grey tab turns into a garbage can and you can drag the icon to the garbage can and it removes it from the home screen(s)
