bug#35623: guix pull failed on RHEL7

bug#35623: guix pull failed on RHEL7

[Karrick McDermott]

Note, I ran this with non privileged permissions, which might be wrong.  I am only sending this email because the program requested it.


[kmcdermo@kmcdermo-ld2 ~]$ uname -a
Linux kmcdermo-ld2.linkedin.biz 3.10.0-514.55.4.el7.x86_64 #1 SMP Fri Aug 10 17:03:02 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux

[kmcdermo@kmcdermo-ld2 ~]$ guix pull
Updating channel 'guix' from Git repository at 'https://git.savannah.gnu.org/git/guix.git'...
Building from this channel:
  guix      https://git.savannah.gnu.org/git/guix.git   338defe
Computing Guix derivation for 'x86_64-linux'...  Backtrace:
In ice-9/boot-9.scm:
   222:29 19 (map1 (((guix i18n)) ((guix colors)) ((guix gexp)) (#) ?))
   222:29 18 (map1 (((guix colors)) ((guix gexp)) ((guix sets)) (#) ?))
   222:29 17 (map1 (((guix gexp)) ((guix sets)) ((guix utils)) (#) ?))
   222:29 16 (map1 (((guix sets)) ((guix utils)) ((guix store)) (#) ?))
   222:29 15 (map1 (((guix utils)) ((guix store)) ((guix config)) # ?))
   222:29 14 (map1 (((guix store)) ((guix config)) ((guix #)) ((?)) ?))
   222:29 13 (map1 (((guix config)) ((guix packages)) ((guix #)) # ?))
   222:29 12 (map1 (((guix packages)) ((guix profiles)) ((guix #)) ?))
   222:17 11 (map1 (((guix profiles)) ((guix derivations)) ((# #)) ?))
  2800:17 10 (resolve-interface (guix profiles) #:select _ #:hide _ # ?)
In ice-9/threads.scm:
    390:8  9 (_ _)
In ice-9/boot-9.scm:
  2726:13  8 (_)
In ice-9/threads.scm:
    390:8  7 (_ _)
In ice-9/boot-9.scm:
  2994:20  6 (_)
   2312:4  5 (save-module-excursion #<procedure 2adf2d0 at ice-9/boo?>)
  3014:26  4 (_)
In unknown file:
           3 (primitive-load-path "guix/profiles" #<procedure 292eae?>)
In ./guix/profiles.scm:
  1788:23  2 (_)
In ./guix/utils.scm:
   661:47  1 (xdg-directory _ "/.config" #:ensure? _)
In unknown file:
           0 (getpw 10452)

ERROR: In procedure getpw:
In procedure getpw: entry not found
-guix pull: error: You found a bug: the program '/gnu/store/4hsmk7kh62yvbi154pyy3nq8drml116a-compute-guix-derivation'
failed to compute the derivation for Guix (version: "338defe0cbe156e8416647035403fccf059555e0"; system: "x86_64-linux";
host version: "1.0.0"; pull-version: 1).
Please report it by email to <bug-guix@gnu.org>.

bug#35623: guix pull failed on RHEL7

[david.larsson]

Hi Karrick,
Is this a regular user or a user you logged into over ssh and authorized 
via pam_ldap or similar? I have noticed similar error but had no problems 
with guix pull for root user or manually created users.

Best regards,
David L

On Tue, 7 May 2019, Karrick McDermott wrote:

> Note, I ran this with non privileged permissions, which might be wrong.  I am only sending this email because the program requested it.
>
>
> [kmcdermo@kmcdermo-ld2 ~]$ uname -a
> Linux kmcdermo-ld2.linkedin.biz 3.10.0-514.55.4.el7.x86_64 #1 SMP Fri Aug 10 17:03:02 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
>
> [kmcdermo@kmcdermo-ld2 ~]$ guix pull
> Updating channel 'guix' from Git repository at 'https://git.savannah.gnu.org/git/guix.git'...
> Building from this channel:
>  guix      https://git.savannah.gnu.org/git/guix.git   338defe
> Computing Guix derivation for 'x86_64-linux'...  Backtrace:
> In ice-9/boot-9.scm:
>   222:29 19 (map1 (((guix i18n)) ((guix colors)) ((guix gexp)) (#) ?))
>   222:29 18 (map1 (((guix colors)) ((guix gexp)) ((guix sets)) (#) ?))
>   222:29 17 (map1 (((guix gexp)) ((guix sets)) ((guix utils)) (#) ?))
>   222:29 16 (map1 (((guix sets)) ((guix utils)) ((guix store)) (#) ?))
>   222:29 15 (map1 (((guix utils)) ((guix store)) ((guix config)) # ?))
>   222:29 14 (map1 (((guix store)) ((guix config)) ((guix #)) ((?)) ?))
>   222:29 13 (map1 (((guix config)) ((guix packages)) ((guix #)) # ?))
>   222:29 12 (map1 (((guix packages)) ((guix profiles)) ((guix #)) ?))
>   222:17 11 (map1 (((guix profiles)) ((guix derivations)) ((# #)) ?))
>  2800:17 10 (resolve-interface (guix profiles) #:select _ #:hide _ # ?)
> In ice-9/threads.scm:
>    390:8  9 (_ _)
> In ice-9/boot-9.scm:
>  2726:13  8 (_)
> In ice-9/threads.scm:
>    390:8  7 (_ _)
> In ice-9/boot-9.scm:
>  2994:20  6 (_)
>   2312:4  5 (save-module-excursion #<procedure 2adf2d0 at ice-9/boo?>)
>  3014:26  4 (_)
> In unknown file:
>           3 (primitive-load-path "guix/profiles" #<procedure 292eae?>)
> In ./guix/profiles.scm:
>  1788:23  2 (_)
> In ./guix/utils.scm:
>   661:47  1 (xdg-directory _ "/.config" #:ensure? _)
> In unknown file:
>           0 (getpw 10452)
>
> ERROR: In procedure getpw:
> In procedure getpw: entry not found
> -guix pull: error: You found a bug: the program '/gnu/store/4hsmk7kh62yvbi154pyy3nq8drml116a-compute-guix-derivation'
> failed to compute the derivation for Guix (version: "338defe0cbe156e8416647035403fccf059555e0"; system: "x86_64-linux";
> host version: "1.0.0"; pull-version: 1).
> Please report it by email to <bug-guix@gnu.org>.
>
>

bug#35623: guix pull failed on RHEL7

[Mark H Weaver]

Hi Karrick,

Karrick McDermott <kmcdermott@linkedin.com> writes:

> Note, I ran this with non privileged permissions, which might be
> wrong.  I am only sending this email because the program requested it.

We normally run 'guix pull' unprivileged, so that's fine.

> [kmcdermo@kmcdermo-ld2 ~]$ guix pull
> Updating channel 'guix' from Git repository at 'https://git.savannah.gnu.org/git/guix.git'...
> Building from this channel:
>   guix      https://git.savannah.gnu.org/git/guix.git   338defe
> Computing Guix derivation for 'x86_64-linux'...  Backtrace:
> In ice-9/boot-9.scm:
>    222:29 19 (map1 (((guix i18n)) ((guix colors)) ((guix gexp)) (#) ?))
>    222:29 18 (map1 (((guix colors)) ((guix gexp)) ((guix sets)) (#) ?))
>    222:29 17 (map1 (((guix gexp)) ((guix sets)) ((guix utils)) (#) ?))
>    222:29 16 (map1 (((guix sets)) ((guix utils)) ((guix store)) (#) ?))
>    222:29 15 (map1 (((guix utils)) ((guix store)) ((guix config)) # ?))
>    222:29 14 (map1 (((guix store)) ((guix config)) ((guix #)) ((?)) ?))
>    222:29 13 (map1 (((guix config)) ((guix packages)) ((guix #)) # ?))
>    222:29 12 (map1 (((guix packages)) ((guix profiles)) ((guix #)) ?))
>    222:17 11 (map1 (((guix profiles)) ((guix derivations)) ((# #)) ?))
>   2800:17 10 (resolve-interface (guix profiles) #:select _ #:hide _ # ?)
> In ice-9/threads.scm:
>     390:8  9 (_ _)
> In ice-9/boot-9.scm:
>   2726:13  8 (_)
> In ice-9/threads.scm:
>     390:8  7 (_ _)
> In ice-9/boot-9.scm:
>   2994:20  6 (_)
>    2312:4  5 (save-module-excursion #<procedure 2adf2d0 at ice-9/boo?>)
>   3014:26  4 (_)
> In unknown file:
>            3 (primitive-load-path "guix/profiles" #<procedure 292eae?>)
> In ./guix/profiles.scm:
>   1788:23  2 (_)
> In ./guix/utils.scm:
>    661:47  1 (xdg-directory _ "/.config" #:ensure? _)
> In unknown file:
>            0 (getpw 10452)
>
> ERROR: In procedure getpw:
> In procedure getpw: entry not found

Guix is trying to find out your home directory, so that it can update
files in ~/.config/guix.  If your HOME environment variable was set, it
would use that, but apparently it's not set, in which case it tries to
use getpw(3) to look up the entry in /etc/passwd corresponding to your
user id.  getpw(3) failed for some reason.

It seems that you're on an unusual system, since HOME is usually set by
default.  Anyway, setting HOME should fix the issue for you.  Please let
us know if that works.

      Thanks,
        Mark

bug#35623: FW: bug#35623: guix pull failed on RHEL7

[Karrick McDermott]

[-- Attachment #1: Type: text/plain, Size: 4747 bytes --]

I accidentally sent this to Mark's private account rather than the per-bug address.

Re-sending it as requested.

-----Original Message-----
From: Karrick McDermott <kmcdermott@linkedin.com>
Date: Wednesday, May 8, 2019 at 8:17 PM
To: Mark H Weaver <mhw@netris.org>
Subject: Re: bug#35623: guix pull failed on RHEL7

    Here's the script output from checking my $HOME environment variable, showing my account id, and showing that my account id is not in the /etc/passwd file, as user accounts on this machine is managed by LDAP.
    
    My $HOME environment variable _is_ set, and I did verify that it is properly exported from the shell so child processes inherit that variable.
    
    I re-ran the command with debugging and attached that as well.
    
    Right now I suspect that Guix is not playing well on systems that use LDAP for user authentication.
    
    
    -----Original Message-----
    From: Mark H Weaver <mhw@netris.org>
    Date: Tuesday, May 7, 2019 at 5:41 PM
    To: Karrick McDermott <kmcdermott@linkedin.com>
    Cc: "35623@debbugs.gnu.org" <35623@debbugs.gnu.org>
    Subject: Re: bug#35623: guix pull failed on RHEL7
    
        Hi Karrick,
        
        Karrick McDermott <kmcdermott@linkedin.com> writes:
        
        > Note, I ran this with non privileged permissions, which might be
        > wrong.  I am only sending this email because the program requested it.
        
        We normally run 'guix pull' unprivileged, so that's fine.
        
        > [kmcdermo@kmcdermo-ld2 ~]$ guix pull
        > Updating channel 'guix' from Git repository at 'https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgit.savannah.gnu.org%2Fgit%2Fguix.git&amp;data=02%7C01%7Ckmcdermott%40linkedin.com%7C01dff6fcc27a44adb81808d6d334ba5d%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C1%7C636928620755383984&amp;sdata=zpxqzoDAP5qsH3%2B%2Fx36vtoVnMDabgMGPtTVdcLlwYW4%3D&amp;reserved=0'...
        > Building from this channel:
        >   guix      https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgit.savannah.gnu.org%2Fgit%2Fguix.git&amp;data=02%7C01%7Ckmcdermott%40linkedin.com%7C01dff6fcc27a44adb81808d6d334ba5d%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C1%7C636928620755393984&amp;sdata=VBl4SXVccPIdCvhLBkBSpwh2d%2BnZIVU%2FvXY0QhWrQfI%3D&amp;reserved=0   338defe
        > Computing Guix derivation for 'x86_64-linux'...  Backtrace:
        > In ice-9/boot-9.scm:
        >    222:29 19 (map1 (((guix i18n)) ((guix colors)) ((guix gexp)) (#) ?))
        >    222:29 18 (map1 (((guix colors)) ((guix gexp)) ((guix sets)) (#) ?))
        >    222:29 17 (map1 (((guix gexp)) ((guix sets)) ((guix utils)) (#) ?))
        >    222:29 16 (map1 (((guix sets)) ((guix utils)) ((guix store)) (#) ?))
        >    222:29 15 (map1 (((guix utils)) ((guix store)) ((guix config)) # ?))
        >    222:29 14 (map1 (((guix store)) ((guix config)) ((guix #)) ((?)) ?))
        >    222:29 13 (map1 (((guix config)) ((guix packages)) ((guix #)) # ?))
        >    222:29 12 (map1 (((guix packages)) ((guix profiles)) ((guix #)) ?))
        >    222:17 11 (map1 (((guix profiles)) ((guix derivations)) ((# #)) ?))
        >   2800:17 10 (resolve-interface (guix profiles) #:select _ #:hide _ # ?)
        > In ice-9/threads.scm:
        >     390:8  9 (_ _)
        > In ice-9/boot-9.scm:
        >   2726:13  8 (_)
        > In ice-9/threads.scm:
        >     390:8  7 (_ _)
        > In ice-9/boot-9.scm:
        >   2994:20  6 (_)
        >    2312:4  5 (save-module-excursion #<procedure 2adf2d0 at ice-9/boo?>)
        >   3014:26  4 (_)
        > In unknown file:
        >            3 (primitive-load-path "guix/profiles" #<procedure 292eae?>)
        > In ./guix/profiles.scm:
        >   1788:23  2 (_)
        > In ./guix/utils.scm:
        >    661:47  1 (xdg-directory _ "/.config" #:ensure? _)
        > In unknown file:
        >            0 (getpw 10452)
        >
        > ERROR: In procedure getpw:
        > In procedure getpw: entry not found
        
        Guix is trying to find out your home directory, so that it can update
        files in ~/.config/guix.  If your HOME environment variable was set, it
        would use that, but apparently it's not set, in which case it tries to
        use getpw(3) to look up the entry in /etc/passwd corresponding to your
        user id.  getpw(3) failed for some reason.
        
        It seems that you're on an unusual system, since HOME is usually set by
        default.  Anyway, setting HOME should fix the issue for you.  Please let
        us know if that works.
        
              Thanks,
                Mark
        
    
    


[-- Attachment #2: guix.out --]
[-- Type: application/octet-stream, Size: 2733 bytes --]

[-- Attachment #3: debug.out --]
[-- Type: application/octet-stream, Size: 95416 bytes --]

bug#35623: FW: bug#35623: guix pull failed on RHEL7

[Ludovic Courtès]

Hi,

Karrick McDermott <kmcdermott@linkedin.com> skribis:

> In ./guix/utils.scm:
>    661:47  1 (xdg-directory _ "/.config" #:ensure? _)
> In unknown file:
>            0 (getpw 10452)
>
> ERROR: In procedure getpw:
> In procedure getpw: entry not found
> \b-guix pull: [1;31merror: [0mYou found a bug: the program '/gnu/store/4hsmk7kh62yvbi154pyy3nq8drml116a-compute-guix-derivation'

This happens because ‘with-clean-environment’ in
‘build-aux/build-self.scm’ clears the environment while executing
“compute-guix-derivation”.  Thus ‘HOME’ is unset.

Additionally, could it be that you’re not running nscd?  See:

  https://gnu.org/software/guix/manual/en/html_node/Application-Setup.html#Name-Service-Switch-1

That said, we could also let ‘HOME’ through in the execution environment
of “compute-guix-derivation”, it can’t hurt.

Thanks,
Ludo’.

bug#35623: FW: bug#35623: guix pull failed on RHEL7

[Karrick McDermott]

1. Glad you identified why `HOME` was unset, due to the `with-clean-environment` function. I am surprised a few environment variables are not conveyed through the code path, as `ssh` does for variables it deems safe, including `HOME`, `LOGNAME`, `TZ`, and `USER`.

2. My RHEL7 machine is _not_ running `nscd` as you surmised.  This machine was configured to use LDAP for user account management.  

3. Thanks for the link to the documentation for post-installation steps on non-Guix systems.  I had that page open in a tab, and never got to it because `guix pull` was failing before I got that far in the instructions.  I'm reading through those now. 


-----Original Message-----
From: Ludovic Courtès <ludo@gnu.org>
Date: Friday, May 10, 2019 at 6:23 PM
To: Karrick McDermott <kmcdermott@linkedin.com>
Cc: "35623@debbugs.gnu.org" <35623@debbugs.gnu.org>
Subject: Re: bug#35623: FW: bug#35623: guix pull failed on RHEL7

    Hi,
    
    Karrick McDermott <kmcdermott@linkedin.com> skribis:
    
    > In ./guix/utils.scm:
    >    661:47  1 (xdg-directory _ "/.config" #:ensure? _)
    > In unknown file:
    >            0 (getpw 10452)
    >
    > ERROR: In procedure getpw:
    > In procedure getpw: entry not found
    > ?-guix pull: [1;31merror: [0mYou found a bug: the program '/gnu/store/4hsmk7kh62yvbi154pyy3nq8drml116a-compute-guix-derivation'
    
    This happens because ‘with-clean-environment’ in
    ‘build-aux/build-self.scm’ clears the environment while executing
    “compute-guix-derivation”.  Thus ‘HOME’ is unset.
    
    Additionally, could it be that you’re not running nscd?  See:
    
      https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgnu.org%2Fsoftware%2Fguix%2Fmanual%2Fen%2Fhtml_node%2FApplication-Setup.html%23Name-Service-Switch-1&amp;data=02%7C01%7Ckmcdermott%40linkedin.com%7C6c139fc36f1242e5299808d6d596266f%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C1%7C636931238208308701&amp;sdata=CxU7cDx1M8ZLDpyQIvsINkttxiQXKeisUYyipLVdeyw%3D&amp;reserved=0
    
    That said, we could also let ‘HOME’ through in the execution environment
    of “compute-guix-derivation”, it can’t hurt.
    
    Thanks,
    Ludo’.
    

bug#35623: FW: bug#35623: guix pull failed on RHEL7

[Ludovic Courtès]

Hello,

Karrick McDermott <kmcdermott@linkedin.com> skribis:

> 1. Glad you identified why `HOME` was unset, due to the `with-clean-environment` function. I am surprised a few environment variables are not conveyed through the code path, as `ssh` does for variables it deems safe, including `HOME`, `LOGNAME`, `TZ`, and `USER`.

In this case this is done on purpose, to make sure that the execution
environment of this program is well under control.

Commit 48d498c2c3984784336b27ba5e261319f3ac6a3a lets HOME pass through,
which should sidestep the problem you encountered.

> 2. My RHEL7 machine is _not_ running `nscd` as you surmised.  This machine was configured to use LDAP for user account management.  

Yes, as the manual explains, you’ll really need to run nscd for proper
operation.

Thank you,
Ludo’.

bug#35623: FW: bug#35623: guix pull failed on RHEL7

[Tobias Geerinckx-Rice]

[-- Attachment #1: Type: text/plain, Size: 360 bytes --]

Ludo',

Ludovic Courtès wrote:
> Commit 48d498c2c3984784336b27ba5e261319f3ac6a3a lets HOME pass
> through, which should sidestep the problem you encountered.

This breaks ‘guix pull’, but I can't for the life of me see how 
HOME is being applied here.

Could you enlighten me?

Kind regards,

T G-R

[0]: https://paste.debian.net/1083404/

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 227 bytes --]

bug#35623: FW: bug#35623: guix pull failed on RHEL7

[Tobias Geerinckx-Rice]

[-- Attachment #1: Type: text/plain, Size: 360 bytes --]

Tobias Geerinckx-Rice wrote:
> Ludovic Courtès wrote:
>> Commit 48d498c2c3984784336b27ba5e261319f3ac6a3a lets HOME pass
>> through, which should sidestep the problem you encountered.
>
> This breaks ‘guix pull’, but I can't for the life of me see how 
> HOME
> is being applied here.

I've reverted the change for now.

Kind regards,

T G-R

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 227 bytes --]

bug#35623: FW: bug#35623: guix pull failed on RHEL7

[Ludovic Courtès]

Hi,

Tobias Geerinckx-Rice <me@tobias.gr> skribis:

> Ludovic Courtès wrote:
>> Commit 48d498c2c3984784336b27ba5e261319f3ac6a3a lets HOME pass
>> through, which should sidestep the problem you encountered.
>
> This breaks ‘guix pull’, but I can't for the life of me see how HOME
> is being applied here.

Ouch, sorry for the mess, and thanks for reverting quickly!

I reverted the revert and added a fix in commit
e0244eb7a2290781ef490b6cedbd9c753caf6004.

Thanks,
Ludo’.

bug#35623: FW: bug#35623: guix pull failed on RHEL7

[Tobias Geerinckx-Rice]

[-- Attachment #1: Type: text/plain, Size: 204 bytes --]

Ludovic Courtès wrote:
> e0244eb7a2290781ef490b6cedbd9c753caf6004.

Hmm.  I guess I'll give ‘SRFI-45 - Primitives for Expressing 
Iterative Lazy Algorithms’(?) a read, then.

Thanks,

T G-R

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 227 bytes --]

bug#35623: FW: bug#35623: guix pull failed on RHEL7

[Tobias Geerinckx-Rice]

[-- Attachment #1: Type: text/plain, Size: 444 bytes --]

Tobias Geerinckx-Rice wrote:
> Ludovic Courtès wrote:
>> e0244eb7a2290781ef490b6cedbd9c753caf6004.
>
> Hmm.  I guess I'll give ‘SRFI-45 - Primitives for Expressing 
> Iterative
> Lazy Algorithms’(?) a read, then.

Never mind, that was the first ‘->’ that looked relevant at first 
glance but it's metasyntactic like most ‘->’s in the Guile manual…

I found it in the Guix manual, of course.

Kind regards,

T G-R

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 227 bytes --]