Can you try the attached patch? It looks like it’s faster here, but I can’t really tell.

Cures the speed problems for me, but the text became fuzzy (MacBook Pro Retina).

Two Emacs instances, without and with the patch:

Thank you very much for working on this!