Easy:
1) Open Gallery (where the file should be loaded) then open the folder where the video is stored. Press on the icon for the video and hold. A menu will appear and choose Delete.
More cumbersome:
2) Connect the phone to your computer. Mount the SD card. Open My Computer (PC) Finder (Mac), then open the SD card. Delete the file from the SD card in the appropriate folder.