From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: =?UTF-8?Q?=E7=A9=8D=E4=B8=B9=E5=B0=BC?= Dan Jacobson Newsgroups: gmane.emacs.bugs Subject: bug#45925: 27.1; *Summary* buffer vs. raw utf-8 headers Date: Wed, 20 Jan 2021 13:58:08 +0800 Message-ID: <87zh14f8un.5.fsf@jidanni.org> References: <87ft30azwi.5.fsf@jidanni.org> <874kjdpk6z.fsf@gnus.org> Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="15900"; mail-complaints-to="usenet@ciao.gmane.io" Cc: 45925@debbugs.gnu.org To: Lars Ingebrigtsen Original-X-From: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Wed Jan 20 07:58:03 2021 Return-path: Envelope-to: geb-bug-gnu-emacs@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1l27RL-00043Q-Q8 for geb-bug-gnu-emacs@m.gmane-mx.org; Wed, 20 Jan 2021 07:58:03 +0100 Original-Received: from localhost ([::1]:44894 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1l27RK-00077G-TE for geb-bug-gnu-emacs@m.gmane-mx.org; Wed, 20 Jan 2021 01:58:02 -0500 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]:48536) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1l27QN-0006rc-TD for bug-gnu-emacs@gnu.org; Wed, 20 Jan 2021 01:57:04 -0500 Original-Received: from debbugs.gnu.org ([209.51.188.43]:41108) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1l27QM-0002Zf-Gt for bug-gnu-emacs@gnu.org; Wed, 20 Jan 2021 01:57:02 -0500 Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1l27QM-0005FZ-Fs; Wed, 20 Jan 2021 01:57:02 -0500 X-Loop: help-debbugs@gnu.org In-Reply-To: <87ft30azwi.5.fsf@jidanni.org> Resent-From: =?UTF-8?Q?=E7=A9=8D=E4=B8=B9=E5=B0=BC?= Dan Jacobson Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org, bugs@gnus.org Resent-Date: Wed, 20 Jan 2021 06:57:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 45925 X-GNU-PR-Package: emacs,gnus Original-Received: via spool by 45925-submit@debbugs.gnu.org id=B45925.161112580920133 (code B ref 45925); Wed, 20 Jan 2021 06:57:02 +0000 Original-Received: (at 45925) by debbugs.gnu.org; 20 Jan 2021 06:56:49 +0000 Original-Received: from localhost ([127.0.0.1]:52647 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1l27Q9-0005Ee-AG for submit@debbugs.gnu.org; Wed, 20 Jan 2021 01:56:49 -0500 Original-Received: from black.elm.relay.mailchannels.net ([23.83.212.19]:9293) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1l27Q6-0005EU-CG for 45925@debbugs.gnu.org; Wed, 20 Jan 2021 01:56:48 -0500 X-Sender-Id: dreamhost|x-authsender|jidanni@jidanni.org Original-Received: from relay.mailchannels.net (localhost [127.0.0.1]) by relay.mailchannels.net (Postfix) with ESMTP id DDBA2401494; Wed, 20 Jan 2021 06:56:44 +0000 (UTC) Original-Received: from pdx1-sub0-mail-a23.g.dreamhost.com (100-96-9-240.trex.outbound.svc.cluster.local [100.96.9.240]) (Authenticated sender: dreamhost) by relay.mailchannels.net (Postfix) with ESMTPA id DB7B54020B4; Wed, 20 Jan 2021 06:56:43 +0000 (UTC) X-Sender-Id: dreamhost|x-authsender|jidanni@jidanni.org Original-Received: from pdx1-sub0-mail-a23.g.dreamhost.com (pop.dreamhost.com [64.90.62.162]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384) by 0.0.0.0:2500 (trex/6.0.1); Wed, 20 Jan 2021 06:56:44 +0000 X-MC-Relay: Neutral X-MailChannels-SenderId: dreamhost|x-authsender|jidanni@jidanni.org X-MailChannels-Auth-Id: dreamhost X-Fumbling-Thoughtful: 1936f9d54f5b8e97_1611125804694_4056827123 X-MC-Loop-Signature: 1611125804694:1515136877 X-MC-Ingress-Time: 1611125804694 Original-Received: from pdx1-sub0-mail-a23.g.dreamhost.com (localhost [127.0.0.1]) by pdx1-sub0-mail-a23.g.dreamhost.com (Postfix) with ESMTP id A272D8484E; Tue, 19 Jan 2021 22:56:43 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=jidanni.org; h=from:to:cc :subject:references:date:message-id:mime-version:content-type :content-transfer-encoding; s=jidanni.org; bh=HVNBPWInkWOo0WUw4/ aFTxKp5y0=; b=Ip6una0c0LG22DeKQAxQFxsMMje0UH95SIf0W1WyFRGkDlzgjF 05HC6Ict5tlxx5OvgR5bnJHuY6IAhu40ImqR0+Itd4/d6Tg78FV5aVrZEKtYFRyT tyHMhS8cx0bkMOyK5ODE9iCuxjUhpGFMTZEQS3y5A3VdhgUTRptH7mZW0= Original-Received: from jidanni.org (36-234-71-202.dynamic-ip.hinet.net [36.234.71.202]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) (Authenticated sender: jidanni@jidanni.org) by pdx1-sub0-mail-a23.g.dreamhost.com (Postfix) with ESMTPSA id 062D67E3B6; Tue, 19 Jan 2021 22:56:42 -0800 (PST) X-DH-BACKEND: pdx1-sub0-mail-a23 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-gnu-emacs@gnu.org List-Id: "Bug reports for GNU Emacs, the Swiss army knife of text editors" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Original-Sender: "bug-gnu-emacs" Xref: news.gmane.io gmane.emacs.bugs:198251 Archived-At: >>>>> "LI" =3D=3D Lars Ingebrigtsen writes: LI> =E7=A9=8D=E4=B8=B9=E5=B0=BC Dan Jacobson writes= : >> Try this simple experiment: >> $ echo Subject: =E4=B8=80=E4=BA=8C=E4=B8=89|procmail >> $ echo Subject: =E4=B8=80=E4=BA=8C=E4=B8=89|iconv -t big5|procmail LI> I don't have procmail installed, so I'm not sure what these do -- are LI> you sending a mail (to yourself?) here? Do you have a recipe to LI> reproduce this problem without the use of procmail? $ echo Subject: =E4=B8=80=E4=BA=8C=E4=B8=89 > ~/Maildir/new/Z $ file ~/Maildir/new/Z ~/Maildir/new/Z: UTF-8 Unicode text >> $ emacs -f gnus >>=20 >> In the *Article* buffer, both look like >> Subject: =E4=B8=80=E4=BA=8C=E4=B8=89 >> In the *Summary* buffer so does the big5 version. >> Alas, the utf-8 version looks like >> c\x80\xd3.... >>=20 >> (Yes, these are illegal raw headers. But Gnus is supposed to be >> accommodating. And it does... but oddly not for the majority (UTF-8) c= ase.) LI> [...] >> (Might be related to bug#45724.) LI> Is this still with nnml? If so, could you find the resulting lines i= n LI> the .overview files in the nnml directory and post them here? (Perha= ps LI> after gzipping them to avoid Emacs helpfully re-encoding the lines.) Yes, nnml. The headers get appended raw to .overview. Thus .overview contains a mix of ASCII, big5, and UTF-8, all in the same = file. $ echo Subject: =E4=B8=80=E4=BA=8C=E4=B8=89|iconv -t big5 > ~/Maildir/new= /B5 $ echo Subject: =E4=B8=80=E4=BA=8C=E4=B8=89 > ~/Maildir/new/UT $ emacs -f gnus $ tail -n 2 Mail/mail/misc/.overview|qprint -e 37397 =3DA4@=3DA4G=3DA4T (nobody) <87a6t4gnpx.5.fsf@t= otally-fudged-out-mess=3D age-id> 0 0 Xref: jidanni5 mail.misc:37397=3D09 37398 =3DE4=3DB8=3D80=3DE4=3DBA=3D8C=3DE4=3DB8=3D89 (nobody) = <878s8ognpx.5.fsf@totally-=3D fudged-out-message-id> 0 0 Xref: jidanni5 mail.misc:= 37398=3D09 Anyway: *Summary* oddly can only deal with raw big5, not raw UTF-8. However *Article* can deal with both.