I don't see why it would be any different in the case of Google; but I don't personally use the Google services to any greater extent these days, so perhaps I'm just not feeling the ramifications ordinary users would.
I actually use Firefox's private browsing feature for browsing untrusted websites. That combined with NoScript should keep me quite (but obviously not entirely) anonymous.
... and, of course, also sign out of Google and any other online service you are logged in!