You can disable the update checker with a very simple config change.[0]

As for :x being slow, I'm not sure what that might be, it certainly isn't the case for me, it quits instantly. Try asking around in their support channels?

[0]: https://www.lazyvim.org/configuration/lazy.nvim (look for "checker" field)