bug#50774: guix-install.sh outputs invalid utf-8 characters

bug#50774: guix-install.sh outputs invalid utf-8 characters

[Dhruvin Gandhi via Bug reports for GNU Guix]

I've recently submitted a patch to builds.sr.ht to support guix build
image. While installing guix binary on foreign distro via
guix-install.sh, it appears that the installer outputs invalid utf-8
characters[1].

References:

[1] https://lists.sr.ht/~sircmpwn/sr.ht-dev/patches/25167#%3CCEH30J59XCDH.3NMOSL8GGLIRF@taiga%3E

bug#50774: guix-install.sh outputs invalid utf-8 characters

[Maxime Devos]

[-- Attachment #1: Type: text/plain, Size: 628 bytes --]

Dhruvin Gandhi via Bug reports for GNU Guix schreef op vr 24-09-2021 om 09:21 [+0000]:
> I've recently submitted a patch to builds.sr.ht to support guix build
> image. While installing guix binary on foreign distro via
> guix-install.sh, it appears that the installer outputs invalid utf-8
> characters[1].
>
> References:
> 
> [1] https://lists.sr.ht/~sircmpwn/sr.ht-dev/patches/25167#%3CCEH30J59XCDH.3NMOSL8GGLIRF@taiga%3E

Where is the invalid UTF-8?  Perhaps the � in

(guix-install log)
...
gpg: key 090B11993D9AEBB5: public key "Ludovic Court�s <ludo@gnu.org>" imported
...

?

Greetings,
Maxime.

[-- Attachment #2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 260 bytes --]

bug#50774: guix-install.sh outputs invalid utf-8 characters

[Dhruvin Gandhi via Bug reports for GNU Guix]

September 24, 2021 10:01 AM, "Maxime Devos" <maximedevos@telenet.be> wrote:

> Dhruvin Gandhi via Bug reports for GNU Guix schreef op vr 24-09-2021 om 09:21 [+0000]:
> 
>> I've recently submitted a patch to builds.sr.ht to support guix build
>> image. While installing guix binary on foreign distro via
>> guix-install.sh, it appears that the installer outputs invalid utf-8
>> characters[1].
>> 
>> References:
>> 
>> [1] https://lists.sr.ht/~sircmpwn/sr.ht-dev/patches/25167#<CEH30J59XCDH.3NMOSL8GGLIRF@taiga>
> 
> Where is the invalid UTF-8? Perhaps the ? in
> 
> (guix-install log)
> ...
> gpg: key 090B11993D9AEBB5: public key "Ludovic Court?s <ludo@gnu.org>" imported
> ...
> 
> ?
> 
> Greetings,
> Maxime.

Hello Maxime,

I ran a build job on builds.sr.ht [1]. Build logs can be found
in artifacts section of the build job [1], i.e. here [2]. I ran
grep -axv '.*' <log.txt> to see which lines are offending and I
only found the one you mentioned above.

References:
[1] https://builds.sr.ht/~dhruvin/job/594887
[2] https://patchouli.sr.ht/builds.sr.ht/artifacts/~dhruvin/594887/ccefd04d43546cb7/log.txt

bug#50774: guix-install.sh outputs invalid utf-8 characters

[Maxime Devos]

[-- Attachment #1: Type: text/plain, Size: 1686 bytes --]

Dhruvin Gandhi schreef op vr 24-09-2021 om 12:21 [+0000]:
> September 24, 2021 10:01 AM, "Maxime Devos" <maximedevos@telenet.be> wrote:
> 
> > Dhruvin Gandhi via Bug reports for GNU Guix schreef op vr 24-09-2021 om 09:21 [+0000]:
> > 
> > > I've recently submitted a patch to builds.sr.ht to support guix build
> > > image. While installing guix binary on foreign distro via
> > > guix-install.sh, it appears that the installer outputs invalid utf-8
> > > characters[1].
> > > 
> > > References:
> > > 
> > > [1] https://lists.sr.ht/~sircmpwn/sr.ht-dev/patches/25167#<CEH30J59XCDH.3NMOSL8GGLIRF@taiga>
> > 
> > Where is the invalid UTF-8? Perhaps the ? in
> > 
> > (guix-install log)
> > ...
> > gpg: key 090B11993D9AEBB5: public key "Ludovic Court?s <ludo@gnu.org>" imported
> > ...
> > 
> > ?
> > 
> > Greetings,
> > Maxime.
> 
> Hello Maxime,
> 
> I ran a build job on builds.sr.ht [1]. Build logs can be found
> in artifacts section of the build job [1], i.e. here [2]. I ran
> grep -axv '.*' <log.txt> to see which lines are offending and I
> only found the one you mentioned above.

This seems like a locale issue:

$ env --ignore-environment LC_ALL=en_US.UTF-8 ~/.guix-profile/bin/gpg --dry-run --list-keys Ludovic
> [...]
> uid           [ expired] Ludovic Courtès <ludo@gnu.org>
> [...]

$ env --ignore-environment ~/.guix-profile/bin/gpg --dry-run --list-keys Ludovic
> [...]
> uid           [ expired] Ludovic Court�s <ludo@gnu.org>
> [...]

Did you set LC_ALL to an UTF-8 locale before running guix-install.sh?
If not, the default ANSI_X3.4-1968 encoding is used, which doesn't support the letter è.

Greetings,
Maxime.

[-- Attachment #2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 260 bytes --]

bug#50774: guix-install.sh outputs invalid utf-8 characters

[Dhruvin Gandhi via Bug reports for GNU Guix]

September 24, 2021 12:51 PM, "Maxime Devos" <maximedevos@telenet.be> wrote:

> Dhruvin Gandhi schreef op vr 24-09-2021 om 12:21 [+0000]:
> 
>> September 24, 2021 10:01 AM, "Maxime Devos" <maximedevos@telenet.be> wrote:
>> 
>> Dhruvin Gandhi via Bug reports for GNU Guix schreef op vr 24-09-2021 om 09:21 [+0000]:
>> 
>>> I've recently submitted a patch to builds.sr.ht to support guix build
>>> image. While installing guix binary on foreign distro via
>>> guix-install.sh, it appears that the installer outputs invalid utf-8
>>> characters[1].
>>> 
>>> References:
>>> 
>>> [1] https://lists.sr.ht/~sircmpwn/sr.ht-dev/patches/25167#<CEH30J59XCDH.3NMOSL8GGLIRF@taiga>
>> 
>> Where is the invalid UTF-8? Perhaps the ? in
>> 
>> (guix-install log)
>> ...
>> gpg: key 090B11993D9AEBB5: public key "Ludovic Court?s <ludo@gnu.org>" imported
>> ...
>> 
>> ?
>> 
>> Greetings,
>> Maxime.
>> 
>> Hello Maxime,
>> 
>> I ran a build job on builds.sr.ht [1]. Build logs can be found
>> in artifacts section of the build job [1], i.e. here [2]. I ran
>> grep -axv '.*' <log.txt> to see which lines are offending and I
>> only found the one you mentioned above.
> 
> This seems like a locale issue:
> 
> $ env --ignore-environment LC_ALL=en_US.UTF-8 ~/.guix-profile/bin/gpg --dry-run --list-keys Ludovic
>> [...]
>> uid [ expired] Ludovic Courtès <ludo@gnu.org>
>> [...]
> 
> $ env --ignore-environment ~/.guix-profile/bin/gpg --dry-run --list-keys Ludovic
>> [...]
>> uid [ expired] Ludovic Court?s <ludo@gnu.org>
>> [...]
> 
> Did you set LC_ALL to an UTF-8 locale before running guix-install.sh?

No

> If not, the default ANSI_X3.4-1968 encoding is used, which doesn't support the letter è.

I think this must be it.

Is defining LC_ALL=en_US.UTF-8 necessary before using the installer? If yes, should we document
it or maybe add it to the installer itself?

bug#50774: guix-install.sh outputs invalid utf-8 characters

[Maxime Devos]

[-- Attachment #1: Type: text/plain, Size: 731 bytes --]

Dhruvin Gandhi schreef op vr 24-09-2021 om 13:26 [+0000]:
> [...]
> > This seems like a locale issue:
> > 
> > [...]
> > Did you set LC_ALL to an UTF-8 locale before running guix-install.sh?
> 
> No
> 
> > If not, the default ANSI_X3.4-1968 encoding is used, which doesn't support the letter è.
> 
> I think this must be it.
> 
> Is defining LC_ALL=en_US.UTF-8 necessary before using the installer? If yes, should we document
> it or maybe add it to the installer itself?

I don't think it is.  Other locales such as LC_ALL=nl_NL.UTF-8 should work too I think,
and an UTF-8 locale isn't required AFAIK, though an UTF-8 locale appears to be required to
get UTF-8 output from guix-install.

Greetings,
Maxime.

[-- Attachment #2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 260 bytes --]

bug#50774: guix-install.sh outputs invalid utf-8 characters

[Maxim Cournoyer]

Hi,

Maxime Devos <maximedevos@telenet.be> writes:

> Dhruvin Gandhi schreef op vr 24-09-2021 om 13:26 [+0000]:
>> [...]
>> > This seems like a locale issue:
>> > 
>> > [...]
>> > Did you set LC_ALL to an UTF-8 locale before running guix-install.sh?
>> 
>> No
>> 
>> > If not, the default ANSI_X3.4-1968 encoding is used, which doesn't support the letter è.
>> 
>> I think this must be it.
>> 
>> Is defining LC_ALL=en_US.UTF-8 necessary before using the installer? If yes, should we document
>> it or maybe add it to the installer itself?
>
> I don't think it is.  Other locales such as LC_ALL=nl_NL.UTF-8 should work too I think,
> and an UTF-8 locale isn't required AFAIK, though an UTF-8 locale appears to be required to
> get UTF-8 output from guix-install.

Closing, as a UTF-8 locale shouldn't be a requirement for using
install.sh.

Thanks for the report!

Maxim