* garbage chars when pasting French chars into emacs @ 2012-02-01 20:41 ken 2012-02-01 21:23 ` Eli Zaretskii 2012-02-01 21:29 ` garbage chars when pasting French chars into emacs Philipp Haselwarter 0 siblings, 2 replies; 9+ messages in thread From: ken @ 2012-02-01 20:41 UTC (permalink / raw To: GNU Emacs List Just to be comprehensive I'll state at the outset that I'm using Linux (CentOS 5.7), so this is the environment emacs is working in. From a shell I get this: $ set|grep -i lang LANG=en_US.UTF-8 Now I pull up a webpage with some French on it: <http://www.wikilivres.info/wiki/Maurice_Merleau-Ponty>. Examining the source code of this page, I see at the top: <meta http-equiv="Content-Type" content="text/html; charset=UTF-8" /> So this page is presented in UTF-8. Firefox is also set to present pages in UTF-8: View -> Character Encoding -> UTF-8 But when I copy and paste the text from "Francais" to "invisible, 1964)" inclusive, many of the characters aren't rendered correctly; I get "garbage" characters in their stead, e.g., the second-to-last line appears something like this: * L^[$(B!G^[$(C)+^[(Bil et l^[$(B!G^[(Besprit, Gallimard, 1960 Other lines are improperly rendered also. I'd like to fix this. And if possible understand why this doesn't work, so I might be able to diagnose these problems for myself. BTW, I'm using GNU Emacs 21.4.1 (i686-redhat-linux-gnu, X toolkit, Xaw3d scroll bars) of 2011-04-28 on builder10.centos.org Yes, it's an older version, but it's the latest from the CentOS 5.7 distribution. (Blame Red Hat.) Thanks for your help. ^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: garbage chars when pasting French chars into emacs 2012-02-01 20:41 garbage chars when pasting French chars into emacs ken @ 2012-02-01 21:23 ` Eli Zaretskii 2012-02-02 2:39 ` ken 2012-02-01 21:29 ` garbage chars when pasting French chars into emacs Philipp Haselwarter 1 sibling, 1 reply; 9+ messages in thread From: Eli Zaretskii @ 2012-02-01 21:23 UTC (permalink / raw To: help-gnu-emacs > Date: Wed, 01 Feb 2012 15:41:42 -0500 > From: ken <gebser@mousecar.com> > > Just to be comprehensive I'll state at the outset that I'm using Linux > (CentOS 5.7), so this is the environment emacs is working in. From a > shell I get this: > > $ set|grep -i lang > LANG=en_US.UTF-8 > > Now I pull up a webpage with some French on it: > <http://www.wikilivres.info/wiki/Maurice_Merleau-Ponty>. Examining the > source code of this page, I see at the top: > > <meta http-equiv="Content-Type" content="text/html; charset=UTF-8" /> > > So this page is presented in UTF-8. > > Firefox is also set to present pages in UTF-8: View -> Character > Encoding -> UTF-8 > > But when I copy and paste the text from "Francais" to "invisible, 1964)" > inclusive, many of the characters aren't rendered correctly; I get > "garbage" characters in their stead, e.g., the second-to-last line > appears something like this: > > * L^[$(B!G^[$(C)+^[(Bil et l^[$(B!G^[(Besprit, Gallimard, 1960 > > Other lines are improperly rendered also. > > I'd like to fix this. And if possible understand why this doesn't work, > so I might be able to diagnose these problems for myself. What is your value of selection-coding-system? Try setting it to something like ctext-with-extensions. ^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: garbage chars when pasting French chars into emacs 2012-02-01 21:23 ` Eli Zaretskii @ 2012-02-02 2:39 ` ken 2012-02-02 3:55 ` Eli Zaretskii 0 siblings, 1 reply; 9+ messages in thread From: ken @ 2012-02-02 2:39 UTC (permalink / raw To: GNU Emacs List On 02/01/2012 04:23 PM Eli Zaretskii wrote: >> Date: Wed, 01 Feb 2012 15:41:42 -0500 >> From: ken <gebser@mousecar.com> >> >> Just to be comprehensive I'll state at the outset that I'm using Linux >> (CentOS 5.7), so this is the environment emacs is working in. From a >> shell I get this: >> >> $ set|grep -i lang >> LANG=en_US.UTF-8 >> >> Now I pull up a webpage with some French on it: >> <http://www.wikilivres.info/wiki/Maurice_Merleau-Ponty>. Examining the >> source code of this page, I see at the top: >> >> <meta http-equiv="Content-Type" content="text/html; charset=UTF-8" /> >> >> So this page is presented in UTF-8. >> >> Firefox is also set to present pages in UTF-8: View -> Character >> Encoding -> UTF-8 >> >> But when I copy and paste the text from "Francais" to "invisible, 1964)" >> inclusive, many of the characters aren't rendered correctly; I get >> "garbage" characters in their stead, e.g., the second-to-last line >> appears something like this: >> >> * L^[$(B!G^[$(C)+^[(Bil et l^[$(B!G^[(Besprit, Gallimard, 1960 >> >> Other lines are improperly rendered also. >> >> I'd like to fix this. And if possible understand why this doesn't work, >> so I might be able to diagnose these problems for myself. > > What is your value of selection-coding-system? Try setting it to > something like ctext-with-extensions. Thanks, Eli, Immediately prior to doing the copy-and-paste I ran all of these: (set-language-environment 'UTF-8) (set-default-coding-systems 'utf-8) (setq file-name-coding-system 'utf-8) (setq default-buffer-file-coding-system 'utf-8) (setq coding-system-for-write 'utf-8) (set-keyboard-coding-system 'utf-8) (set-terminal-coding-system 'utf-8) (set-clipboard-coding-system 'utf-8) (set-selection-coding-system 'utf-8) (prefer-coding-system 'utf-8) (modify-coding-system-alist 'process "\\*shell\\*\\'" 'utf-8-unix) Following your advice, I ran (set-selection-coding-system 'ctext-with-extensions) and then did the same copy-and-paste again. This got more of the characters correct, but not all of them. So we're a lot closer.... Got another suggestion? ^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: garbage chars when pasting French chars into emacs 2012-02-02 2:39 ` ken @ 2012-02-02 3:55 ` Eli Zaretskii 2012-02-02 20:00 ` ken 0 siblings, 1 reply; 9+ messages in thread From: Eli Zaretskii @ 2012-02-02 3:55 UTC (permalink / raw To: help-gnu-emacs > Date: Wed, 01 Feb 2012 21:39:22 -0500 > From: ken <gebser@mousecar.com> > > > What is your value of selection-coding-system? Try setting it to > > something like ctext-with-extensions. > > Thanks, Eli, > > Immediately prior to doing the copy-and-paste I ran all of these: > > (set-language-environment 'UTF-8) > (set-default-coding-systems 'utf-8) > (setq file-name-coding-system 'utf-8) > (setq default-buffer-file-coding-system 'utf-8) > (setq coding-system-for-write 'utf-8) > (set-keyboard-coding-system 'utf-8) > (set-terminal-coding-system 'utf-8) > (set-clipboard-coding-system 'utf-8) > (set-selection-coding-system 'utf-8) > (prefer-coding-system 'utf-8) > (modify-coding-system-alist 'process "\\*shell\\*\\'" 'utf-8-unix) Not a good idea, I'm afraid: the UTF-8 support in Emacs 21 left a lot to be desired. > Following your advice, I ran > > (set-selection-coding-system 'ctext-with-extensions) > > and then did the same copy-and-paste again. This got more of the > characters correct, but not all of them. Can you show the original text, and then what you have after pasting? I need to see which characters aren't pasted correctly. ^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: garbage chars when pasting French chars into emacs 2012-02-02 3:55 ` Eli Zaretskii @ 2012-02-02 20:00 ` ken 2012-02-03 7:31 ` Eli Zaretskii 0 siblings, 1 reply; 9+ messages in thread From: ken @ 2012-02-02 20:00 UTC (permalink / raw To: GNU Emacs List On 02/01/2012 10:55 PM Eli Zaretskii wrote: >> Date: Wed, 01 Feb 2012 21:39:22 -0500 >> From: ken <gebser@mousecar.com> >> >>> What is your value of selection-coding-system? Try setting it to >>> something like ctext-with-extensions. >> Thanks, Eli, >> >> Immediately prior to doing the copy-and-paste I ran all of these: >> >> (set-language-environment 'UTF-8) >> (set-default-coding-systems 'utf-8) >> (setq file-name-coding-system 'utf-8) >> (setq default-buffer-file-coding-system 'utf-8) >> (setq coding-system-for-write 'utf-8) >> (set-keyboard-coding-system 'utf-8) >> (set-terminal-coding-system 'utf-8) >> (set-clipboard-coding-system 'utf-8) >> (set-selection-coding-system 'utf-8) >> (prefer-coding-system 'utf-8) >> (modify-coding-system-alist 'process "\\*shell\\*\\'" 'utf-8-unix) > > Not a good idea, I'm afraid: the UTF-8 support in Emacs 21 left a lot > to be desired. > >> Following your advice, I ran >> >> (set-selection-coding-system 'ctext-with-extensions) >> >> and then did the same copy-and-paste again. This got more of the >> characters correct, but not all of them. Looking again, I see my eyes must have been malfunctioning for the text pasted into emacs is rendered correctly. However, when I try to save the text, I'm presented with the minibuffer message "Select coding system (default iso-2022-jp-2): ". At the same time a second buffer opens under the first giving the options for coding system: =================================================================== These default coding systems were tried: mule-utf-8-unix iso-latin-1 However, none of them safely encodes the target text. Select one of the following safe coding systems: iso-2022-jp-2 x-ctext iso-2022-7bit raw-text emacs-mule no-conversion ctext-no-compositions iso-2022-8bit-ss2 iso-2022-7bit-lock iso-2022-7bit-ss2 tibetan-iso-8bit-with-esc thai-tis620-with-esc lao-with-esc korean-iso-8bit-with-esc hebrew-iso-8bit-with-esc greek-iso-8bit-with-esc iso-latin-9-with-esc iso-latin-8-with-esc iso-latin-5-with-esc iso-latin-4-with-esc iso-latin-3-with-esc iso-latin-2-with-esc iso-latin-1-with-esc in-is13194-devanagari-with-esc cyrillic-iso-8bit-with-esc chinese-iso-8bit-with-esc japanese-iso-8bit-with-esc =================================================================== Entering "utf-8" into the minibuffer, of course, doesn't work. Frankly, I'd like to save into utf-8, this to avoid having problems with this same file at a later time when I add more text to it. > Can you show the original text, and then what you have after pasting? > I need to see which characters aren't pasted correctly. The original text must have been edited out somewhere in the thread. It's at <http://www.wikilivres.info/wiki/Maurice_Merleau-Ponty>, from "Francais" through the end of the unordered list, ie, the line ending with "et l’invisible, 1964". Here it is: ========================================================== Français * La Structure du comportement, 1942 * La Phénoménologie de la perception, 1945 * Humanisme et terreur, 1947 * Sens et non-sens, 1948 * Les Sciences de l’homme et la phénoménologie * Les Relations avec autrui chez l’enfant * Éloge de la philosophie, leçon inaugurale faite au collège de France, le jeudi 15 janvier 1953 * Signes, 1960 * L’œil et l’esprit, Gallimard, 1960 * Le visible et l’invisible, 1964 ========================================================== Thanks again for your help. ^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: garbage chars when pasting French chars into emacs 2012-02-02 20:00 ` ken @ 2012-02-03 7:31 ` Eli Zaretskii 2012-02-06 18:01 ` different distro [was: Re: garbage chars when pasting French chars into emacs] ken 0 siblings, 1 reply; 9+ messages in thread From: Eli Zaretskii @ 2012-02-03 7:31 UTC (permalink / raw To: help-gnu-emacs > Date: Thu, 02 Feb 2012 15:00:37 -0500 > From: ken <gebser@mousecar.com> > > >> Following your advice, I ran > >> > >> (set-selection-coding-system 'ctext-with-extensions) > >> > >> and then did the same copy-and-paste again. This got more of the > >> characters correct, but not all of them. > > Looking again, I see my eyes must have been malfunctioning for the text > pasted into emacs is rendered correctly. However, when I try to save > the text, I'm presented with the minibuffer message "Select coding > system (default iso-2022-jp-2): ". At the same time a second buffer > opens under the first giving the options for coding system: > > =================================================================== > These default coding systems were tried: > mule-utf-8-unix iso-latin-1 > However, none of them safely encodes the target text. > > Select one of the following safe coding systems: > iso-2022-jp-2 x-ctext iso-2022-7bit raw-text emacs-mule no-conversion > ctext-no-compositions iso-2022-8bit-ss2 iso-2022-7bit-lock > iso-2022-7bit-ss2 tibetan-iso-8bit-with-esc thai-tis620-with-esc > lao-with-esc korean-iso-8bit-with-esc hebrew-iso-8bit-with-esc > greek-iso-8bit-with-esc iso-latin-9-with-esc iso-latin-8-with-esc > iso-latin-5-with-esc iso-latin-4-with-esc iso-latin-3-with-esc > iso-latin-2-with-esc iso-latin-1-with-esc > in-is13194-devanagari-with-esc cyrillic-iso-8bit-with-esc > chinese-iso-8bit-with-esc japanese-iso-8bit-with-esc > =================================================================== > > Entering "utf-8" into the minibuffer, of course, doesn't work. Frankly, > I'd like to save into utf-8 You can't, not with Emacs 21. In that version, the same character in different character sets was treated as 2 different characters. Also, the mule-utf-8 character set didn't include the Latin-1 characters. The only suggestion I have is to try iso-latin-1-with-esc (you will see above that this is one of the possibilities suggested by Emacs), it should at least produce a Latin-1 encoded file, which will be easier on you later. You really need to upgrade your Emacs, if you want to use UTF-8. ^ permalink raw reply [flat|nested] 9+ messages in thread
* different distro [was: Re: garbage chars when pasting French chars into emacs] 2012-02-03 7:31 ` Eli Zaretskii @ 2012-02-06 18:01 ` ken 2012-02-06 20:15 ` Peter Dyballa 0 siblings, 1 reply; 9+ messages in thread From: ken @ 2012-02-06 18:01 UTC (permalink / raw To: GNU Emacs List On 02/03/2012 02:31 AM Eli Zaretskii wrote: >> Date: Thu, 02 Feb 2012 15:00:37 -0500 >> From: ken <gebser@mousecar.com> >> >>>> .... >> >> Select one of the following safe coding systems: >> iso-2022-jp-2 x-ctext iso-2022-7bit raw-text emacs-mule no-conversion >> ctext-no-compositions iso-2022-8bit-ss2 iso-2022-7bit-lock >> iso-2022-7bit-ss2 tibetan-iso-8bit-with-esc thai-tis620-with-esc >> lao-with-esc korean-iso-8bit-with-esc hebrew-iso-8bit-with-esc >> greek-iso-8bit-with-esc iso-latin-9-with-esc iso-latin-8-with-esc >> iso-latin-5-with-esc iso-latin-4-with-esc iso-latin-3-with-esc >> iso-latin-2-with-esc iso-latin-1-with-esc >> in-is13194-devanagari-with-esc cyrillic-iso-8bit-with-esc >> chinese-iso-8bit-with-esc japanese-iso-8bit-with-esc >> =================================================================== >> >> Entering "utf-8" into the minibuffer, of course, doesn't work. Frankly, >> I'd like to save into utf-8 > > You can't, not with Emacs 21. In that version, the same character in > different character sets was treated as 2 different characters. Also, > the mule-utf-8 character set didn't include the Latin-1 characters. > > The only suggestion I have is to try iso-latin-1-with-esc (you will > see above that this is one of the possibilities suggested by Emacs), > it should at least produce a Latin-1 encoded file, which will be > easier on you later. > > You really need to upgrade your Emacs, if you want to use UTF-8. Thanks, Eli, for all the good advice. I was using v.22 previously, but was hoping to stay with the standard (CentOS/Red Hat) distribution. This situation and your insight have convinced me I've got to use a more recent emacs. I'm thinking now of doing an edgier distro, some rpm/yum based thing like Fedora. Suggestions appreciated. Thanks again to all for the great tips. ^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: different distro [was: Re: garbage chars when pasting French chars into emacs] 2012-02-06 18:01 ` different distro [was: Re: garbage chars when pasting French chars into emacs] ken @ 2012-02-06 20:15 ` Peter Dyballa 0 siblings, 0 replies; 9+ messages in thread From: Peter Dyballa @ 2012-02-06 20:15 UTC (permalink / raw To: gebser; +Cc: GNU Emacs List Am 6.2.2012 um 19:01 schrieb ken: > I'm thinking now of doing an edgier distro, some rpm/yum based thing like Fedora. Suggestions appreciated. Fedora is a good choice – although I was bugged first when copy & paste like your's also inserted "control chars". -- Greetings Pete Encryption, n.: A powerful algorithmic encoding technique employed in the creation of computer manuals. ^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: garbage chars when pasting French chars into emacs 2012-02-01 20:41 garbage chars when pasting French chars into emacs ken 2012-02-01 21:23 ` Eli Zaretskii @ 2012-02-01 21:29 ` Philipp Haselwarter 1 sibling, 0 replies; 9+ messages in thread From: Philipp Haselwarter @ 2012-02-01 21:29 UTC (permalink / raw To: help-gnu-emacs Works perfectly for me (GNU Emacs 24). Do you use emacs in a terminal or in graphic mode? Is building a newer emacs an option? If it's a single user workstation or if you're the only emacs user it shouldn't be hard. -- Philipp Haselwarter ^ permalink raw reply [flat|nested] 9+ messages in thread
end of thread, other threads:[~2012-02-06 20:15 UTC | newest] Thread overview: 9+ messages (download: mbox.gz follow: Atom feed -- links below jump to the message on this page -- 2012-02-01 20:41 garbage chars when pasting French chars into emacs ken 2012-02-01 21:23 ` Eli Zaretskii 2012-02-02 2:39 ` ken 2012-02-02 3:55 ` Eli Zaretskii 2012-02-02 20:00 ` ken 2012-02-03 7:31 ` Eli Zaretskii 2012-02-06 18:01 ` different distro [was: Re: garbage chars when pasting French chars into emacs] ken 2012-02-06 20:15 ` Peter Dyballa 2012-02-01 21:29 ` garbage chars when pasting French chars into emacs Philipp Haselwarter
Code repositories for project(s) associated with this external index https://git.savannah.gnu.org/cgit/emacs.git https://git.savannah.gnu.org/cgit/emacs/org-mode.git This is an external index of several public inboxes, see mirroring instructions on how to clone and mirror all data and code used by this external index.