From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!.POSTED.blaine.gmane.org!not-for-mail From: Eli Zaretskii Newsgroups: gmane.emacs.bugs Subject: bug#34862: 27.0.50; Trying to update pinyin.map Date: Fri, 15 Mar 2019 07:03:30 +0200 Message-ID: <83ftro20gt.fsf@gnu.org> References: <87zhpxyvls.fsf@ericabrahamsen.net> Injection-Info: blaine.gmane.org; posting-host="blaine.gmane.org:195.159.176.226"; logging-data="179601"; mail-complaints-to="usenet@blaine.gmane.org" Cc: 34862@debbugs.gnu.org To: Eric Abrahamsen Original-X-From: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane.org@gnu.org Fri Mar 15 06:04:15 2019 Return-path: Envelope-to: geb-bug-gnu-emacs@m.gmane.org Original-Received: from lists.gnu.org ([209.51.188.17]) by blaine.gmane.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:256) (Exim 4.89) (envelope-from ) id 1h4f0w-000kar-Te for geb-bug-gnu-emacs@m.gmane.org; Fri, 15 Mar 2019 06:04:15 +0100 Original-Received: from localhost ([127.0.0.1]:49852 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1h4f0v-0000mJ-KG for geb-bug-gnu-emacs@m.gmane.org; Fri, 15 Mar 2019 01:04:13 -0400 Original-Received: from eggs.gnu.org ([209.51.188.92]:57150) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1h4f0l-0000ki-OY for bug-gnu-emacs@gnu.org; Fri, 15 Mar 2019 01:04:04 -0400 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1h4f0k-00065Z-TY for bug-gnu-emacs@gnu.org; Fri, 15 Mar 2019 01:04:03 -0400 Original-Received: from debbugs.gnu.org ([209.51.188.43]:59000) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1h4f0k-00065N-Ll for bug-gnu-emacs@gnu.org; Fri, 15 Mar 2019 01:04:02 -0400 Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1h4f0k-0005AV-DH for bug-gnu-emacs@gnu.org; Fri, 15 Mar 2019 01:04:02 -0400 X-Loop: help-debbugs@gnu.org Resent-From: Eli Zaretskii Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Fri, 15 Mar 2019 05:04:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 34862 X-GNU-PR-Package: emacs Original-Received: via spool by 34862-submit@debbugs.gnu.org id=B34862.155262623719857 (code B ref 34862); Fri, 15 Mar 2019 05:04:02 +0000 Original-Received: (at 34862) by debbugs.gnu.org; 15 Mar 2019 05:03:57 +0000 Original-Received: from localhost ([127.0.0.1]:44311 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1h4f0f-0005AD-5r for submit@debbugs.gnu.org; Fri, 15 Mar 2019 01:03:57 -0400 Original-Received: from eggs.gnu.org ([209.51.188.92]:42748) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1h4f0c-00059z-J3 for 34862@debbugs.gnu.org; Fri, 15 Mar 2019 01:03:55 -0400 Original-Received: from fencepost.gnu.org ([2001:470:142:3::e]:50070) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1h4f0W-000627-VQ; Fri, 15 Mar 2019 01:03:49 -0400 Original-Received: from [176.228.60.248] (port=2589 helo=home-c4e4a596f7) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1h4f0W-0001W9-Dc; Fri, 15 Mar 2019 01:03:48 -0400 In-reply-to: <87zhpxyvls.fsf@ericabrahamsen.net> (message from Eric Abrahamsen on Thu, 14 Mar 2019 14:49:51 -0700) X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 209.51.188.43 X-BeenThere: bug-gnu-emacs@gnu.org List-Id: "Bug reports for GNU Emacs, the Swiss army knife of text editors" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane.org@gnu.org Original-Sender: "bug-gnu-emacs" Xref: news.gmane.org gmane.emacs.bugs:156371 Archived-At: > From: Eric Abrahamsen > Date: Thu, 14 Mar 2019 14:49:51 -0700 > > > As discussed in bug#34215, I'm trying to update the > romanization-to-Chinese-character mapping in the > file ./leim/MISC-DIC/pinyin.map to use the more complete mapping > provided by the Google pinyin input method, licensed under Apache 2.0. > This expands the number of characters recognized by Emacs from around > 7,000 to around 17,000. (And increases the size of the mapping file from > 18K to 53K.) > > I'm running into encoding problems when adding the new characters -- > Emacs says some of the characters can't be written using the existing > coding system. The original file has an encoding cookie reading coding: > cn-gb-2312, and describing the coding system gives me: > > chinese-iso-8bit-dos (alias: cn-gb-2312-dos euc-china-dos euc-cn-dos > cn-gb-dos gb2312-dos) > > The characters *can* be encoded using gb18030, and of course utf8. The > wikipedia page for gb18030 describes gb2312 as "legacy"[1], and says > gb18030 is a superset of 2312. > > Is there any reason not to go straight to utf8 for this file? If that's > not okay, would gb18030 be acceptable? I'm not sure I understand the encoding of which file would you like to change? Could you please clarify?