From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp2 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id oCz3GDMntl9FOgAA0tVLHw (envelope-from ) for ; Thu, 19 Nov 2020 08:05:07 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp2 with LMTPS id CIPiFDMntl+saQAAB5/wlQ (envelope-from ) for ; Thu, 19 Nov 2020 08:05:07 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 9B54B940480 for ; Thu, 19 Nov 2020 08:05:06 +0000 (UTC) Received: from localhost ([::1]:60234 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kfewC-0002K5-FR for larch@yhetil.org; Thu, 19 Nov 2020 03:05:04 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:40204) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kfevC-0002Hf-Uz for bug-guix@gnu.org; Thu, 19 Nov 2020 03:04:04 -0500 Received: from debbugs.gnu.org ([209.51.188.43]:54697) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1kfevC-0003sS-LD for bug-guix@gnu.org; Thu, 19 Nov 2020 03:04:02 -0500 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1kfevC-0003Gq-Gj for bug-guix@gnu.org; Thu, 19 Nov 2020 03:04:02 -0500 X-Loop: help-debbugs@gnu.org Subject: bug#44735: gilbc of the running system got wiped while building a package, system broken Resent-From: Stefan Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Thu, 19 Nov 2020 08:04:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: report 44735 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: 44735@debbugs.gnu.org X-Debbugs-Original-To: bug-guix@gnu.org Received: via spool by submit@debbugs.gnu.org id=B.160577303512557 (code B ref -1); Thu, 19 Nov 2020 08:04:02 +0000 Received: (at submit) by debbugs.gnu.org; 19 Nov 2020 08:03:55 +0000 Received: from localhost ([127.0.0.1]:38010 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kfev4-0003GS-L7 for submit@debbugs.gnu.org; Thu, 19 Nov 2020 03:03:55 -0500 Received: from lists.gnu.org ([209.51.188.17]:48694) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kfev1-0003GI-PR for submit@debbugs.gnu.org; Thu, 19 Nov 2020 03:03:53 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:40068) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kfev1-0002AK-Jq for bug-guix@gnu.org; Thu, 19 Nov 2020 03:03:51 -0500 Received: from vsmx011.vodafonemail.xion.oxcs.net ([153.92.174.89]:55493) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kfeux-0003jH-V2 for bug-guix@gnu.org; Thu, 19 Nov 2020 03:03:50 -0500 Received: from vsmx003.vodafonemail.xion.oxcs.net (unknown [192.168.75.197]) by mta-5-out.mta.xion.oxcs.net (Postfix) with ESMTP id B7F2459D7A2 for ; Thu, 19 Nov 2020 08:03:43 +0000 (UTC) Received: from macbook-pro.kuh-wiese.my-router.de (unknown [88.70.113.67]) by mta-7-out.mta.xion.oxcs.net (Postfix) with ESMTPA id 7DCBF5399F9 for ; Thu, 19 Nov 2020 08:03:41 +0000 (UTC) From: Stefan Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Message-Id: <9763EBD0-9CDC-4A06-A113-F6443CB4348D@vodafonemail.de> Date: Thu, 19 Nov 2020 09:03:41 +0100 Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) X-Mailer: Apple Mail (2.3124) X-VADE-STATUS: LEGIT Received-SPF: pass client-ip=153.92.174.89; envelope-from=stefan-guix@vodafonemail.de; helo=vsmx011.vodafonemail.xion.oxcs.net X-detected-operating-system: by eggs.gnu.org: First seen = 2020/11/19 03:03:44 X-ACL-Warn: Detected OS = Linux 2.2.x-3.x (no timestamps) [generic] [fuzzy] X-Spam_score_int: -25 X-Spam_score: -2.6 X-Spam_bar: -- X-Spam_report: (-2.6 / 5.0 requ) BAYES_00=-1.9, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: -1.3 (-) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-Spam-Score: -2.3 (--) X-BeenThere: bug-guix@gnu.org List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-guix-bounces+larch=yhetil.org@gnu.org Sender: "bug-Guix" X-Scanner: ns3122888.ip-94-23-21.eu Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of bug-guix-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=bug-guix-bounces@gnu.org X-Spam-Score: -0.51 X-TUID: rbedFcGnRrju Hi! After trying to just build a package (with a modified guix, but this is = certainly unrelated), the system broke catastrophically: stefan@guix ~/development/guix$ sudo -E ./pre-inst-env guix-daemon = --build-users-group=3Dguixbuild & stefan@guix ~/development/guix$ = /home/stefan/development/guix/pre-inst-env guix build -L = /home/stefan/guix u-boot-rpi-3 accepted connection from pid 23848, user stefan substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% 12,5 MB will be downloaded: /gnu/store/ldg4jqfan2vp01lm255zz7zrb4vllixp-libxau-1.0.9 /gnu/store/m1r4jwmc56q44x31xcnvg1hcijf0lq88-libxcb-1.14 /gnu/store/8b75zmsyxc5qghfrxhyqi6g23bq993b1-libbsd-0.10.0 /gnu/store/z18hwxwgk551y4a0f6j1dxhmp208i4ha-bash-static-5.0.16 /gnu/store/cb88z63hyg1icd2kkahiink2p291mhr2-glibc-2.31 /gnu/store/z7hanmdmdalqh1v0y7z8ilinfhyfh91d-glibc-2.31-static /gnu/store/pcsl88vd66k62sk1g4wcc9i985xn369m-libxdmcp-1.1.3 /gnu/store/785ldh00ix897pamyg5p6fpjls6ddwzz-libx11-1.6.A-doc /gnu/store/x10mk7ri4ny013km57d3h5093270r7pg-libx11-1.6.A substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% substituting = /gnu/store/785ldh00ix897pamyg5p6fpjls6ddwzz-libx11-1.6.A-doc... downloading from = https://ci.guix.gnu.org/nar/lzip/785ldh00ix897pamyg5p6fpjls6ddwzz-libx11-1= .6.A-doc ... libx11-1.6.A-doc 1.2MiB = 309KiB/s 00:04 [##################] 100.0% substituting = /gnu/store/z18hwxwgk551y4a0f6j1dxhmp208i4ha-bash-static-5.0.16... downloading from = https://ci.guix.gnu.org/nar/lzip/z18hwxwgk551y4a0f6j1dxhmp208i4ha-bash-sta= tic-5.0.16 ... bash-static-5.0.16 502KiB = 976KiB/s 00:01 [##################] 100.0% guix build: error: cannot unlink = `/gnu/store/cb88z63hyg1icd2kkahiink2p291mhr2-glibc-2.31/share/locale/de/LC= _MESSAGES': Directory not empty stefan@guix ~/development/guix$ = /home/stefan/development/guix/pre-inst-env guix build -L = /home/stefan/guix u-boot-rpi-3 accepted connection from pid 23911, user stefan substitute: updating substitutes from 'https://ci.guix.gnu.org'... = 100.0% 12,0 MB will be downloaded: /gnu/store/ldg4jqfan2vp01lm255zz7zrb4vllixp-libxau-1.0.9 /gnu/store/m1r4jwmc56q44x31xcnvg1hcijf0lq88-libxcb-1.14 /gnu/store/8b75zmsyxc5qghfrxhyqi6g23bq993b1-libbsd-0.10.0 /gnu/store/cb88z63hyg1icd2kkahiink2p291mhr2-glibc-2.31 /gnu/store/z7hanmdmdalqh1v0y7z8ilinfhyfh91d-glibc-2.31-static /gnu/store/pcsl88vd66k62sk1g4wcc9i985xn369m-libxdmcp-1.1.3 /gnu/store/785ldh00ix897pamyg5p6fpjls6ddwzz-libx11-1.6.A-doc /gnu/store/x10mk7ri4ny013km57d3h5093270r7pg-libx11-1.6.A guix build: error: cannot unlink = `/gnu/store/cb88z63hyg1icd2kkahiink2p291mhr2-glibc-2.31/lib/gconv': = Directory not empty stefan@guix ~/development/guix$ = /home/stefan/development/guix/pre-inst-env guix build -L = /home/stefan/guix u-boot-rpi-3 -bash: /home/stefan/development/guix/pre-inst-env: /bin/sh: Defekter = Interpreter: No such file or directory stefan@guix ~/development/guix$ ls -bash: /run/current-system/profile/bin/ls: No such file or directory stefan@guix ~/development/guix$ echo $PATH = /run/setuid-programs:/home/stefan/.config/guix/current/bin:/home/stefan/.g= uix-profile/bin:/run/current-system/profile/bin:/run/current-system/profil= e/sbin stefan@guix ~/development/guix$ ls -bash: /run/current-system/profile/bin/ls: No such file or directory The problem that the unlink was not successful was certainly due to a = deleted but still opened file on the NFS share. There may be an = intermediate hidden .nfs=E2=80=A6 file, which get created in such a case = (=E2=80=9Cdelete on last close=E2=80=9D, =E2=80=9Csilly rename=E2=80=9D), = However, the RFC-5661 for NFS demands even if = OPEN4_RESULT_PRESERVE_UNLINKED is supported, that the directory entry of = an open file must not be removed in this case, thus preventing a = directory removal. Taking a look on the nfs-server, this is now the content of the glibc: # ls gnu/store/cb88z63hyg1icd2kkahiink2p291mhr2-glibc-2.31/lib -l total 12 drwxr-xr-x 2 root root 12288 Nov 18 19:41 gconv lrwxrwxrwx 7 root root 11 Jan 1 1970 libanl.so -> libanl.so.1 Everything is missing. Of course I tried to reboot the system, but because of the missing = ld-linux-aarch64.so.1 the system is not booting properly. This leaves some questions: If the whole system (maybe not the booted/running one, but a = reconfigured one) was already using = /gnu/store/cb88z63hyg1icd2kkahiink2p291mhr2-glibc-2.31, why has it been = downloaded again when building a package? Was this due to grafting? How can it be that the store is kind of =E2=80=9Cstate=E2=80=9C being = modified on the fly? How does it come that removing files for = /gnu/store/cb88z63hyg1icd2kkahiink2p291mhr2-glibc-2.31 happens before = the download even started? Could this render a system unusable if a = network loss happens at the right point in time? Booting the previous system generation luckily worked =E2=80=93 it must = be using a different glibc version. But now what about that broken glibc = version? How to repair it? The garbage collector will not remove it, as = it is still referenced by the latest system generation. Actually I = don=E2=80=99t want to delete that generation. The database certainly = believes, that this glibc package is installed correctly. What to do = now? The used guix version used when building the package was = f6a42ac946edccc7de5e93ee247487cbec40072b. Bye Stefan