I'm not so much talking about "reasoning using language", I mean that if you have intermediate reasoning results, you can mentally express them in language, which means you can still remember them after you have focused on something else for a minute. Otherwise you might forget them very quickly. Because we apparently can't hold a lot of thoughts in mind, while we can easily store words in memory.