For pre-installed Apps that I don't use, I generally set them to 'Disabled'. This way they don't waste my mobile data allowance or phone storage getting updates. A few examples I disabled on my phone include Facebook and Twitter as I don't use either social network. The first thing you need to do is look at the app list and take note of every app you don't plan using.
Go into Settings, then into 'Apps'. Swipe to the right repetitively until you reach the 'All' screen. Look for the first app you'd like to disable and go into it. Touch 'Uninstall updates'. Then touch 'Disable'. It'll throw up a warning about doing so, so just agree to that. Scroll down to where you see the 'Clear data' and touch it. Repeat for the 'Clear cache' button. Repeat for the next app until you've all the ones you don't plan using disabled.
Don't disable system apps, i.e. Apps that you don't see on your main app list. These generally have a tiny size of 4KB to 100KB (at least on my HTC) and many can't be disabled anyway.