Your downloaded apps will be saved on the Market for redownloading.
Your songs and pics would be saved to your microSD card, which you can upload to your computer with the USB cable and save to your computer.
What do you mean, "How do I see the Market?"
I go into the Market icon and then hit "Menu" The options for "downloads" will appear, providing you with all the apps you've downloaded. Does that make sense?