evil-mode was causing issues because of corfu. Looking around it seems like the issue is because of some change in evil-collection, which in Guix ATM is pretty outdated. So I created this issue on their repo, https://github.com/emacs-evil/evil-collection/issues/786

and they have a new tag up now, I created this patch to update emacs-evil-collection package to the latest tag now.