You're probably not closing them to begin with. Unless an app has an explicit exit you're not actually closing the app.
Long Press on the home key will allow you to switch between apps
A shortpress of the home button and then opening another app as usual won't close the previous app. The system will close it when memory is needed. You may have to do it that way because the long press only shows the last 6 apps that you opened.
Sent from my Droid using Tapatalk