If I start emacs normally and then start the server with M-x server-start then start emacsclient the key translation works in the client frame. The problem only occurs when emacsclient starts the server