From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Alexandre Duret-Lutz Newsgroups: gmane.emacs.bugs Subject: bug#44307: 27.1; UTF-8 parts transferred as 8bit in multipart messages fail to decode Date: Sun, 10 Jan 2021 15:02:27 +0100 Message-ID: <874kjoc2ks.fsf@lrde.epita.fr> References: <8735zj6q6h.fsf@goulash.lrde.epita.fr> <8735zf3f46.fsf@gnus.org> <87k0srg0hz.fsf@goulash.lrde.epita.fr> <87wnwo3kd2.fsf@gnus.org> <87wnwo7muj.fsf@lrde.epita.fr> <87wnwlugd0.fsf@gnus.org> Mime-Version: 1.0 Content-Type: text/plain Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="5660"; mail-complaints-to="usenet@ciao.gmane.io" User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.0.50 (gnu/linux) Cc: 44307@debbugs.gnu.org To: Lars Ingebrigtsen Original-X-From: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Sun Jan 10 15:03:12 2021 Return-path: Envelope-to: geb-bug-gnu-emacs@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1kybJI-0001Ly-2N for geb-bug-gnu-emacs@m.gmane-mx.org; Sun, 10 Jan 2021 15:03:12 +0100 Original-Received: from localhost ([::1]:59224 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kybJG-0004iN-O3 for geb-bug-gnu-emacs@m.gmane-mx.org; Sun, 10 Jan 2021 09:03:10 -0500 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]:35334) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kybJ9-0004iH-41 for bug-gnu-emacs@gnu.org; Sun, 10 Jan 2021 09:03:03 -0500 Original-Received: from debbugs.gnu.org ([209.51.188.43]:41943) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1kybJ8-0000e3-Lt for bug-gnu-emacs@gnu.org; Sun, 10 Jan 2021 09:03:02 -0500 Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1kybJ8-0006Kv-G7; Sun, 10 Jan 2021 09:03:02 -0500 X-Loop: help-debbugs@gnu.org In-Reply-To: Resent-From: Alexandre Duret-Lutz Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org, bugs@gnus.org Resent-Date: Sun, 10 Jan 2021 14:03:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 44307 X-GNU-PR-Package: emacs,gnus Original-Received: via spool by 44307-submit@debbugs.gnu.org id=B44307.161028736324313 (code B ref 44307); Sun, 10 Jan 2021 14:03:02 +0000 Original-Received: (at 44307) by debbugs.gnu.org; 10 Jan 2021 14:02:43 +0000 Original-Received: from localhost ([127.0.0.1]:53489 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kybIo-0006K5-IL for submit@debbugs.gnu.org; Sun, 10 Jan 2021 09:02:42 -0500 Original-Received: from mail-wm1-f53.google.com ([209.85.128.53]:32828) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kybIm-0006FL-Ou for 44307@debbugs.gnu.org; Sun, 10 Jan 2021 09:02:41 -0500 Original-Received: by mail-wm1-f53.google.com with SMTP id n16so9441014wmc.0 for <44307@debbugs.gnu.org>; Sun, 10 Jan 2021 06:02:40 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:from:to:cc:subject:references:date:message-id:user-agent :mime-version; bh=+GVgAcsnb+N1wzc2NezmEfnBg7Rkf1RS72gLOXexeug=; b=cJkT4yU9iX+3e6PrOwGVjk3i4YjT37KKjAYHLZeB7mMtPEk1wKfDqmJj/SuE8A4QGp 9rY+/PYyGE68ohIX5OPe8EtpiLcy0YAS6IGte8wUQYFCIYOJQVxurBRA1ZOSDaVEuRbY G/GgawQd1roWtdhCzVwW1RBKYqtT3xrPQv17v6qRi6iUhSlAPP/gpOpR6Wde9BotZb46 jCMXoXth0ED8tkk0nflsRFPoFvBE5YvZUHYutNB8SneJfEJJYXci4mKY7Z4uq+oOVZ5h /UdtTI7lDWDqxlbokwrcAtW0hBrVTosMvhA0uEVRjd+PfvZy68/y7CVRlhtwcgaEJipD cDxQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:from:to:cc:subject:references:date :message-id:user-agent:mime-version; bh=+GVgAcsnb+N1wzc2NezmEfnBg7Rkf1RS72gLOXexeug=; b=clMz5tpC+0Ldri10m85BK/nkuF8KA5h3Or1rVWjVp93XN50kEvwFIlodHiWlow+lJ4 DVaDjWlCd5jZEfVzCgIJ7IIbM5cUAHSEcpiPtJL6TbP1+cz0gKu2fmoIZfVVuPKBF2jr FjuqoVutmtqoMMNj2DbjLJW4BZqSrVY8xs0nQ7H0StC8u+B/MKC3Qw58yeZ/NNQjg9Fv ZFyQkUhCULW9Yg8zpME6YAAEWqjmlV9YYSb6IhQkpcC2wulSEZoAWGA8lJvgCzoOVDSm ZEYrG7Y1T0CmZMrHd7bm0TdOrTBGeEijc3EyfO/grGpPCfcdJ/hcTk/dfPkYGAD1sxu/ wfhA== X-Gm-Message-State: AOAM533H97y8kICVx/sMayEmSkhYWivgCcg4HH7D+dz1XSO8KdCqDPE/ eCFURjfsr7P1+M5BFnSRl1wS88wsaBHfAQ== X-Google-Smtp-Source: ABdhPJwGkpJFizTmOABWBrD5k7h/YB8ybBOPt7JGLXObXGlT2TSeofz/zXkscWQslGW4iRGtKkET5w== X-Received: by 2002:a7b:cc90:: with SMTP id p16mr10575962wma.105.1610287354723; Sun, 10 Jan 2021 06:02:34 -0800 (PST) Original-Received: from goulash (89-109-190-109.dsl.ovh.fr. [109.190.109.89]) by smtp.gmail.com with ESMTPSA id c7sm22918755wro.16.2021.01.10.06.02.33 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 10 Jan 2021 06:02:33 -0800 (PST) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-gnu-emacs@gnu.org List-Id: "Bug reports for GNU Emacs, the Swiss army knife of text editors" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Original-Sender: "bug-gnu-emacs" Xref: news.gmane.io gmane.emacs.bugs:197608 Archived-At: Lars Ingebrigtsen writes: > What about the following patch? > > @@ -1351,7 +1351,8 @@ nnmaildir-request-article > - (nnheader-insert-file-contents nnmaildir-article-file-name)) > + (let ((nnheader-file-coding-system nnmail-file-coding-system)) > + (nnheader-insert-file-contents nnmaildir-article-file-name))) I was playing with something similar this morning: @@ -1351,7 +1351,9 @@ nnmaildir-request-article (throw 'return nil)) (with-current-buffer (or to-buffer nntp-server-buffer) (erase-buffer) - (nnheader-insert-file-contents nnmaildir-article-file-name)) + (mm-disable-multibyte) + (let ((coding-system-for-read mm-text-coding-system)) + (nnheader-insert-file-contents nnmaildir-article-file-name))) (cons gname num-msgid)))) mm-text-coding-system and nnmail-file-coding-system both default to 'raw-text. Without (mm-disable-multibyte), the patch makes no difference to me. The documentation for 'raw-text on https://www.gnu.org/software/emacs/manual/html_node/emacs/Coding-Systems.html states that 'raw-text causes enable-multibyte-characters to be set to nil, but it's not clear when this should occur, and printing enable-multibyte-characters after the call to nnheader-insert-file-contents still shows t. Adding (mm-disable-multibyte) to the patch seems help a lot, although the first impression is much worse: 1. When a mail is first displayed (using RET or g), the article buffer is unibyte with all non-ascii characters displayed as backslash sequences. This occurs for all mails, even QP-encoded ones. 2. When a mail is displayed for the second time (using g on the same article or RET to change article and come back), the display is *perfect*. I.e., plain/text and plain/html parts that are encoded with either utf-8 or windows-1252 are correctly displayed for me. 3. Running M-x gnus-backlog-shutdown gets me back to 1. where all non-ascii characters are displayed as backslashes. PS: all of this is with an updated emacs 28, including the reverted mm-with-part change. -- Alexandre Duret-Lutz