unofficial mirror of emacs-devel@gnu.org 
 help / color / mirror / code / Atom feed
From: Eli Zaretskii <eliz@gnu.org>
To: Kenichi Handa <handa@m17n.org>
Cc: emacs-devel@gnu.org
Subject: What exactly is chinese-big5?
Date: Thu, 17 Apr 2008 07:15:04 -0400	[thread overview]
Message-ID: <E1JmS52-0000vS-J3@fencepost.gnu.org> (raw)

Emacs 22.2 supports the chinese-big5 encoding.  However, I cannot find
anywhere the precise description of which flavor(s) of BIG5 is/are
supported.  The Wiki page http://en.wikipedia.org/wiki/Big5 describes
half a dozen of extensions to the original Big5 encoding, so it would
be good to know which one(s) we support.

The specific situation where I needed to know this was when I was
handed a file with what was supposed to be Chinese text and was asked
to convert it to UTF-8.  detect-coding-region suggested chinese-big5
as the only Chinese encoding for the non-ASCII characters in the file,
so I tried that.  Interestingly enough, both `recode' and `iconv'
refused to convert the file, no matter what flavor of Big5 (including
cp950) I tried, but Emacs read the file with no problems and produced
what seems like a valid UTF-8 encoding.  `iconv' 1.12 supports quite a
few Big5 flavors, but they all choked on some characters in the file.

So what exactly is chinese-big5 in Emacs, and how come it succeeds
where the latest `iconv' fails?  In particular, should I worry about
possibly incorrect conversion by Emacs, where `iconv' barfs (the file
is very large and I cannot proofread all the converted strings)?

TIA




             reply	other threads:[~2008-04-17 11:15 UTC|newest]

Thread overview: 8+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2008-04-17 11:15 Eli Zaretskii [this message]
2008-04-18  1:32 ` What exactly is chinese-big5? Kenichi Handa
2008-04-18  8:16   ` Eli Zaretskii
2008-04-18 11:28     ` Kenichi Handa
2008-04-18 12:47       ` Eli Zaretskii
2008-04-18 13:37         ` Jason Rumney
2008-04-18 15:52           ` Eli Zaretskii
2008-04-18 13:26       ` Jason Rumney

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

  List information: https://www.gnu.org/software/emacs/

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=E1JmS52-0000vS-J3@fencepost.gnu.org \
    --to=eliz@gnu.org \
    --cc=emacs-devel@gnu.org \
    --cc=handa@m17n.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
Code repositories for project(s) associated with this public inbox

	https://git.savannah.gnu.org/cgit/emacs.git

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).