On that Nokia I had (model 5800 XpressMusic), geotagging was on by default. On my current phone (Android based Sony Xperia Ray), Geotag was off by default.
One thing I am surprised is that phones and GPS-enabled cameras don’t give an automatic Geotag option, i.e. a setting where geotagging is automatically enabled while outside of the home country or a certain mileage from the home county/city.
For example, if the phone’s home location is set to Ireland, photos will only be geotagged if the GPS coordinates are outside of the country, such as while on holiday where geotagging is actually useful and without the risk of forgetting to switch it back off when returning home.
I also remember hearing a similar issue in the early days of Satnavs, as a stolen Satnav could be used to find the owner’s house (i.e. choosing ‘Take me Home’), since since anyone who could afford a Satnav likely had other valuable stuff at their home. The workaround to avoid this was to set the Satnav’s home location to an easy to get to location (e.g. local supermarket), so this way the user can still use the ‘Take me home’ feature without someone being able to use the Satnav find the owner’s home.