From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Daniel =?UTF-8?Q?Mart=C3=ADn?= via "Bug reports for GNU Emacs, the Swiss army knife of text editors" Newsgroups: gmane.emacs.bugs Subject: bug#51832: Piping unicode text in `shell-command' Date: Sun, 14 Nov 2021 16:01:17 +0100 Message-ID: References: <834k8fw62v.fsf@gnu.org> <87y25r8968.fsf@gnus.org> <83mtm7upc4.fsf@gnu.org> <87tugf881r.fsf@gnus.org> <83k0hbuosm.fsf@gnu.org> <87h7cf84l1.fsf@gnus.org> <87czn383z6.fsf@gnus.org> <83h7cfuixu.fsf@gnu.org> <9EB4417D-2457-46AD-9198-E42BBAF11071@gmail.com> <83czn3uhtd.fsf@gnu.org> <87v90u7t2l.fsf@gnus.org> <44FDC8DA-6F3B-4896-B019-D98A9E7D72E7@gmail.com> Reply-To: Daniel =?UTF-8?Q?Mart=C3=ADn?= Mime-Version: 1.0 Content-Type: text/plain Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="34770"; mail-complaints-to="usenet@ciao.gmane.io" User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.2 (darwin) Cc: Lars Ingebrigtsen , 51832@debbugs.gnu.org, tor.a.s.kringeland@ntnu.no, Alan Third To: Philipp Original-X-From: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Sun Nov 14 16:02:32 2021 Return-path: Envelope-to: geb-bug-gnu-emacs@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1mmH1a-0008qp-MC for geb-bug-gnu-emacs@m.gmane-mx.org; Sun, 14 Nov 2021 16:02:31 +0100 Original-Received: from localhost ([::1]:58814 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1mmH1Z-00034h-Nn for geb-bug-gnu-emacs@m.gmane-mx.org; Sun, 14 Nov 2021 10:02:29 -0500 Original-Received: from eggs.gnu.org ([209.51.188.92]:53986) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mmH18-00032z-FQ for bug-gnu-emacs@gnu.org; Sun, 14 Nov 2021 10:02:03 -0500 Original-Received: from debbugs.gnu.org ([209.51.188.43]:39776) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1mmH18-0000x6-6b for bug-gnu-emacs@gnu.org; Sun, 14 Nov 2021 10:02:02 -0500 Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1mmH18-0002M1-0D for bug-gnu-emacs@gnu.org; Sun, 14 Nov 2021 10:02:02 -0500 X-Loop: help-debbugs@gnu.org Resent-From: Daniel =?UTF-8?Q?Mart=C3=ADn?= Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Sun, 14 Nov 2021 15:02:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 51832 X-GNU-PR-Package: emacs Original-Received: via spool by 51832-submit@debbugs.gnu.org id=B51832.16369020939010 (code B ref 51832); Sun, 14 Nov 2021 15:02:01 +0000 Original-Received: (at 51832) by debbugs.gnu.org; 14 Nov 2021 15:01:33 +0000 Original-Received: from localhost ([127.0.0.1]:51322 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1mmH0f-0002LG-E6 for submit@debbugs.gnu.org; Sun, 14 Nov 2021 10:01:33 -0500 Original-Received: from sonic306-20.consmr.mail.ir2.yahoo.com ([77.238.176.206]:42423) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1mmH0b-0002Kt-6S for 51832@debbugs.gnu.org; Sun, 14 Nov 2021 10:01:31 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.es; s=s2048; t=1636902081; bh=HDlML7KjsgkLZBI8nWO1H/Brvzp9Rd8xbfgS8Iu8VAY=; h=From:To:Cc:Subject:References:Date:In-Reply-To:From:Subject:Reply-To; b=FecGctF6hrCAsrejiu9+2ro9YiliTwI5xOFKLnsA2fsgTIBoI06Qh54qbbxUfLzY4TjWBy+8jhVqdl2D1mmXlG+OiszVqUSR4NYhkzS2RwRu5LZ7Yv5xe+W7UaOfTzOlIwJjwdc0vVTTsMScnCh6o7mJQ5Pqzhp+G7USjuJFHtaDuVm7V5vmqKPqpD17BntM0YJD1ym8dSA/eBDbfGdeLm07ATMoQVZK7sONVmFcdnRvJ2cZGzo0SA+/5HnPxZrb4B5LcQJXvwoyFNBmUTN3ceZffnTtLtDWFtdfh2aRjVjzc35XzySfgDEIZTAWCCf9BQvTMrV4hBZVk3eDvlCAmQ== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1636902081; bh=qAcnxGvJ2/vY40pLTO0baElt0MKDQO1cDtUAYUq6Y1k=; h=X-Sonic-MF:From:To:Subject:Date:From:Subject; b=Srz/nzjpLBVZpV2roFmqyazlwcW33ty4MhCDdbMaPomcxi/OuFiHE2jB43lp3Ouq+aqklpkeoKxjmJHaiy5EXUQvjLkRiabWn0HM1S7RxZcRX5dRxvAfqQysXjHL6zJ+SA+KWrvmY88XuYZU+VYQnBVsnR8xVFaDJOA+daUGwzoM/1MQZbQBX6HW6jYtTo7rhZD4c7EZtaNDzLZpVbYw6+cfClXwFyazn+4NhGFLx3bnRfkR3Dd0WX80+rRfTDWUTQ72rkQMJlz5jYEZ+i5MV3Qvtobe9WrScBOUSSZ66P4ljS9BaVoT2jYT0wxcbvaHjWv0UShPPJ1GaYH5kGqOLQ== X-YMail-OSG: PkUtj2MVM1nfUU1cJtCoIIoWDSOhGozHi05Y1Cd.cxkUu.TNV7E__1OVcHGVJuN rxZwXtYRtatUp.MCPkrGM0xSLWSEyf2OhtsZaSqr3v.w5a92vt6AjJP30NjDoP.yyKDbOSP8W6mv Kx.afvgv4eb6BUIKorT54GnIwMG4K4CHO3P06u4wv0HCxN8qBjF4rVf7yXe86D9G2iWqMmkdb4oS Xs1MMkaenM23UlJDr7FoIhTBGbwQsiDq.R5RQzK9SK7Z09MFHivETdRpflfcg6xjdXQ094LXIV7B 5zjayZ0JoenngpC5JHWIF_yKj1eML2d_Ng83Ywk1SGR7Ih4ojwMwGqw9DqOh4eTEo6ARiGxOu68l ocJPvaCQqOCXaE83WYJHxGz0s4TiRkOVXznCAv5wzvyP5Ou.NBVEj64t5.k19GEDT_coNeNhFu_M bcq4Z_.STzkcBVdbQY3TQ9549gXqRuKSRt615udEfGC9mSRx2k7oCvsFg2FXPJqeaUjQ8CY22W5J p9WpIU_5XuyI2krWTvtTLpIOSONvaJ6IyV_TZlyPfF1bSWBgleJCANT8CZSG1.7HjcNxtEiPdary 5INGOTDrOLIzS6.A.gHDJY9ePLK_wA3wSqP1rDYm9pZaiPuIX01iwcXydKVDFe5o.pJlXtQT8u.c Jtaduy4z6cvWgISEgOHJX0GOm50611ffbcOUuG.Ou3Sy6j6CdlrA4Yw8ON7EZVrxQnR_k5AGjjZ6 h4F3yyQLw0uz_78VpPfPPj0FxXhN.o30rXBnrhu0MVROWkwTGKxoyX4Y3meb5iZWUIrKTCHH5rwp xsdDU5vH9tFN238AhAdLt1BqwCDOOVz_QNApMObavO X-Sonic-MF: Original-Received: from sonic.gate.mail.ne1.yahoo.com by sonic306.consmr.mail.ir2.yahoo.com with HTTP; Sun, 14 Nov 2021 15:01:21 +0000 Original-Received: by kubenode519.mail-prod1.omega.ir2.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 9682ac9765ec018f490c7379ac82e85a; Sun, 14 Nov 2021 15:01:19 +0000 (UTC) In-Reply-To: <44FDC8DA-6F3B-4896-B019-D98A9E7D72E7@gmail.com> (Philipp's message of "Sun, 14 Nov 2021 15:23:03 +0100") X-Mailer: WebService/1.1.19306 mail.backend.jedi.jws.acl:role.jedi.acl.token.atz.jws.hermes.yahoo X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-gnu-emacs@gnu.org List-Id: "Bug reports for GNU Emacs, the Swiss army knife of text editors" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Original-Sender: "bug-gnu-emacs" Xref: news.gmane.io gmane.emacs.bugs:219950 Archived-At: Philipp writes: >> Am 14.11.2021 um 14:41 schrieb Lars Ingebrigtsen : >> >> Alan Third writes: >> >>> I've attached a patch that may do something towards preventing this >>> problem but ultimately this is a convenience to give a best guess at >>> choosing the correct dictionary, date format, etc. If we can't easily >>> fix it then we can drop it and tell people to set it in their init.el >>> themselves. >> >> That didn't fix the issue for me, I'm afraid -- with that patch, LANG is >> still the invalid en_NO.UTF-8 for me. > > Maybe we should add similar logic as iTerm2 > (https://github.com/gnachman/iTerm2/blob/79aff4d59fd591e7628649bcabe5f27541740bf6/sources/PTYSession.m#L7107): > create the locale identifier from language code and country code > instead of the current locale identifier, and use setlocale (or > better, newlocale) to check whether it's valid, and fall back to > en_US.UTF-8 otherwise? Native macOS Terminal also has similar logic that calls setlocale. It tries to setlocale on LC_ALL (first argument 0) with these locale identifiers in turn, until one of them succeeds: - "localeIdentifier.UTF-8" - "languageCode_countryCode.UTF-8" - "languageCode_countryCode" So they seem to give preference to [[NSLocale currentLocale] localeIdentifier] and only use "languageCode_countryCode" as fallback.