Hold the icon till it releases and can be moved. Drag to the gray app tab at the bottom of the screen. They both will turn red. Drop the icon while it's red and "poof" it's deleted.
To re-add it to your desktop, slid up on the gray app tab at the bottom of the screen. This opens up the App Drawer. locate the Gallery Icon and hold it till it releases and drag it to your desktop.