From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp2 ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id 0OfZIouMEWFOIQAAgWs5BA (envelope-from ) for ; Mon, 09 Aug 2021 22:14:03 +0200 Received: from aspmx1.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp2 with LMTPS id ePFZHouMEWHxaQAAB5/wlQ (envelope-from ) for ; Mon, 09 Aug 2021 20:14:03 +0000 Received: from mail.notmuchmail.org (nmbug.tethera.net [144.217.243.247]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id CCA771056 for ; Mon, 9 Aug 2021 22:14:02 +0200 (CEST) Received: from nmbug.tethera.net (localhost [127.0.0.1]) by mail.notmuchmail.org (Postfix) with ESMTP id DFE4626A0A; Mon, 9 Aug 2021 16:13:58 -0400 (EDT) Received: from lahtoruutu.iki.fi (lahtoruutu.iki.fi [185.185.170.37]) by mail.notmuchmail.org (Postfix) with ESMTPS id B45AB203A3 for ; Mon, 9 Aug 2021 16:13:56 -0400 (EDT) Received: from guru.guru-group.fi (unknown [IPv6:2a02:2380:1:9:5054:ff:feb7:a4bc]) (using TLSv1.2 with cipher AES256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: too) by lahtoruutu.iki.fi (Postfix) with ESMTPSA id 00C0D1B00332; Mon, 9 Aug 2021 23:13:54 +0300 (EEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=iki.fi; s=lahtoruutu; t=1628540035; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=eRILth4EsxU+CwGSq7KmuVHpddoY6hSzVkbxN30kiDg=; b=kjbXYV0fb5lgI2dZFQRgYzsx9Da+SABKopWNw7vktAGFbOXV0msPqIehiZT4CYobRF4qjs aOvxUKIwAuQGPmuxs3lSvS5s6Mh9w4hflXSTz321GJF/q7xcSElKg4wF+MedLoCzzzVNeG PZBp76mr6LfU10EafPZ8WozgovCHAz/ke7HPxN5z34o3aQxHz7xwPgVnIs+KPAgxPMiT7N gcawLzGurJcCqQNwcH3Lh2Oi69NDe4X7aD1gJZzjbIZFpoay7cC3QYsSA0WHTt38Ynwaru yS2bqiourcw8Bb4BimLh2Z8mcdeMIHbW36+CgrpoXlzbCn+MZl2gBrABG3cKig== From: Tomi Ollila To: David Bremner , Wenlong Dai , notmuch@notmuchmail.org Subject: Re: Why some characters are not displayed correctly when setting mm-text-html-renderer to links In-Reply-To: <877dgyv29e.fsf@tethera.net> References: <877dgyv29e.fsf@tethera.net> User-Agent: Notmuch/0.32+21~gfdddd4c (https://notmuchmail.org) Emacs/27.1 X-Face: HhBM'cA~ MIME-Version: 1.0 ARC-Authentication-Results: i=1; ORIGINATING; auth=pass smtp.auth=too smtp.mailfrom=tomi.ollila@iki.fi ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=iki.fi; s=lahtoruutu; t=1628540035; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=eRILth4EsxU+CwGSq7KmuVHpddoY6hSzVkbxN30kiDg=; b=e7TU9KmQgObMWXvo8tU5Ab+HVyBbYrR8bi/+mLTCiTzkcfph7QxhPaMb4SJW9ZnK5tw6AA ZuvVGFqNhz3GtYRwYETurOt/goXybiaBkUw8mOJqG+QNsyugdUUtl3Gy91niBT2EDYurHH RlNBeYYV73pYjZBHHwdSt3gXmXhXCJZoT38EWA4+5Sj0aMkRxct27scmGGZx2XsOul9SBZ xogcnGqsYvGx948TR6SGA+vXp96I1NeQxBpI9193pJQxu/9bgJQeX8QDO3e3D3XgWz4y9N phNeitnyvh63vSveuPG2SvzHiNUn1dsgCbu2RxUO+kZWCB+24lEd+NL50i4QTg== ARC-Seal: i=1; s=lahtoruutu; d=iki.fi; t=1628540035; a=rsa-sha256; cv=none; b=IA7S4zlQFZ3CcqEsmoouQsiD7y6Eb9lpYIa7kCK+JzIkAmPscElCZ3JmxKI31ojc/VZhow dyHNP8gwh1UBv4QDco03l1nnN7G7xbF1mB/8LuhfN3vNag8gOTuKYVFpugD7+S0rIeonw0 zs0vA25mHmbWruueTTqEMy3pstZfqSmZPn5pL1o/OgKHJPTHx9EfgWabYetYQ96tlVuL3p RhmJBUe0sLkrB2tjgfq/xiXd1HIbHYvEUZv1hLt4KeEsI1xvAGEeAU1OIfOuEtqFFbbAlE 24w0zjArXevJAtm2G47FUIMFsV1jG3rUl4rkP5k+B71wsLmULVEgZwtC7G8ONQ== Message-ID-Hash: LFODYGCSF3VS6G7A226DHPPXBIUW3GSF X-Message-ID-Hash: LFODYGCSF3VS6G7A226DHPPXBIUW3GSF X-MailFrom: tomi.ollila@iki.fi X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-notmuch.notmuchmail.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; suspicious-header X-Mailman-Version: 3.2.1 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Help: List-Post: List-Subscribe: List-Unsubscribe: Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Migadu-Flow: FLOW_IN ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1628540042; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=n9G0ENipPF8RkMMLTJWr4avhOuaX2uA3ZEdaVmSlgyw=; b=pkZR3BWiu8AiMUnJt+cWEkSXhmzRcpZNavofCPs8KyUnpLRgO5ao85amxc2/Xu4527LV0W MXD8DSLPrvD1C4QzRCeKQAeY+YX0EIb+D4G9r7THi3N5j/TpJmL2ffR8mIp1cBDkSFnECe nwRXqGoqOTomQ5vvcrJu22J031ON2qLAsktFpJPDYePpdwYrjoP50xszVEOCWnJPIR5fAE Xtmyr+247UKZsAJcWFC0WKnnxtAVF4Mr/+x7QRxvT6DOndkp+SRt4g/xwcNnQsH69y7vE7 F94sJ/XYZZdtlggvvqiO4lDY6xTw6lRhMCZ0CPDxm6ZF15s+4zBhly9CFx3jxw== ARC-Seal: i=2; s=key1; d=yhetil.org; t=1628540042; a=rsa-sha256; cv=fail; b=qLbqAcC2GHysQF7qROVmlgkpQXsXMYHeiYynPNm27rV3ndjUOHcoCPUwrQwdN3A8MZmo9A vgS+uMhwM/ZY4y3spLQ8rd+UqNtna1lHDr7UBFzrBYHGZuFIPu2iZJF+z5oPloiE678L3l Z/r3Y4fXJFjlf+qAHA8e0jdbWdk2fh1Pc/Z/M9kNaxmHznq/AGqcbuLnTtxFmrO/xA7FXJ rK3wt9ZNRSM4qVPGL6vJ17hNfwoTGzAnA4wC0FRmlDkEuvXXMmTbjf6tYwO5GtzuymD7Z7 noKrq46UD4Bed7TjxgTiGZbZDejGwLVtApay1fPc03+GY3vhXRHAq7bWHNwGPQ== ARC-Authentication-Results: i=2; aspmx1.migadu.com; dkim=fail ("body hash did not verify") header.d=iki.fi header.s=lahtoruutu header.b=kjbXYV0f; arc=reject ("signature check failed: fail, {[1] = sig:iki.fi:reject}"); dmarc=none; spf=pass (aspmx1.migadu.com: domain of notmuch-bounces@notmuchmail.org designates 144.217.243.247 as permitted sender) smtp.mailfrom=notmuch-bounces@notmuchmail.org X-Migadu-Spam-Score: 0.99 Authentication-Results: aspmx1.migadu.com; dkim=fail ("body hash did not verify") header.d=iki.fi header.s=lahtoruutu header.b=kjbXYV0f; arc=reject ("signature check failed: fail, {[1] = sig:iki.fi:reject}"); dmarc=none; spf=pass (aspmx1.migadu.com: domain of notmuch-bounces@notmuchmail.org designates 144.217.243.247 as permitted sender) smtp.mailfrom=notmuch-bounces@notmuchmail.org X-Migadu-Queue-Id: CCA771056 X-Spam-Score: 0.99 X-Migadu-Scanner: scn1.migadu.com X-TUID: PhdOslreG52h On Fri, Aug 06 2021, David Bremner wrote: > Wenlong Dai writes: > >> >> After some research, I found that setting mm-text-html-renderer to links >> would reduce the load time from >> to around 2 seconds or less. But one small issue with this is some >> characters are not displayed correctly, for example the >> RIGHT SINGLE QUOTATION MARK, which would be displayed as \342\200\231 >> > > I didn't have time to debug this yet, but I did duplicate the problem on > Emacs 27.1 on Debian, so it is not Windows or gccemacs specific. As far > as I can tell links is outputing non-utf8 characters, but it could also > be other issues like double decoding. setting those "coding-systems" is somewhat hard to understand (or it is just me) -- i recall wondering these (let ((coding-system-for-read 'no-conversion)) iirc in related code... One thing could be to wrap the 'links' command in a shell script which executes exec strace -o /tmp/strace.$$ -e trace=open /path/to/links "$@"' (name that script as 'links' and point first entry in PATH to the directory that exists) then one can check the logs what is links outputting (i'd guess it would output utf-8 characters but one cannot know for sure...) Tomi > > d