From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp2 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id UzlwH8kiF2BUIAAA0tVLHw (envelope-from ) for ; Sun, 31 Jan 2021 21:36:09 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp2 with LMTPS id 8Ly1GskiF2CnDwAAB5/wlQ (envelope-from ) for ; Sun, 31 Jan 2021 21:36:09 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id D47E69403C9 for ; Sun, 31 Jan 2021 21:36:08 +0000 (UTC) Received: from localhost ([::1]:43170 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1l6KO7-0000op-QY for larch@yhetil.org; Sun, 31 Jan 2021 16:36:07 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:47868) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1l6KO1-0000og-TB for bug-guix@gnu.org; Sun, 31 Jan 2021 16:36:01 -0500 Received: from debbugs.gnu.org ([209.51.188.43]:46678) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1l6KO1-0005Vz-Lt for bug-guix@gnu.org; Sun, 31 Jan 2021 16:36:01 -0500 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1l6KO1-00071O-Je for bug-guix@gnu.org; Sun, 31 Jan 2021 16:36:01 -0500 X-Loop: help-debbugs@gnu.org Subject: bug#41669: Cross-compiled powerpc64-linux bootstrap-tarballs not reproducible Resent-From: Ludovic =?UTF-8?Q?Court=C3=A8s?= Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Sun, 31 Jan 2021 21:36:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 41669 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Chris Marusich Received: via spool by 41669-submit@debbugs.gnu.org id=B41669.161212893726959 (code B ref 41669); Sun, 31 Jan 2021 21:36:01 +0000 Received: (at 41669) by debbugs.gnu.org; 31 Jan 2021 21:35:37 +0000 Received: from localhost ([127.0.0.1]:58224 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1l6KNb-00070j-Sc for submit@debbugs.gnu.org; Sun, 31 Jan 2021 16:35:37 -0500 Received: from eggs.gnu.org ([209.51.188.92]:58234) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1l6KNX-00070V-RZ for 41669@debbugs.gnu.org; Sun, 31 Jan 2021 16:35:35 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]:39581) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1l6KNS-0005Gs-5G; Sun, 31 Jan 2021 16:35:26 -0500 Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=51390 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1l6KNJ-0002V3-9C; Sun, 31 Jan 2021 16:35:25 -0500 From: Ludovic =?UTF-8?Q?Court=C3=A8s?= References: <87wo0hqbb3.fsf@gmail.com> <87pn3dth0l.fsf_-_@gmail.com> <874krtnvk8.fsf@gmail.com> <87y2p4mqe2.fsf@gmail.com> <87a6xu2xrj.fsf@gmail.com> <20200913062858.GC1100@E5400> <87wo0hqbb3.fsf@gmail.com> <874krtnvk8.fsf@gmail.com> <87y2p4mqe2.fsf@gmail.com> <87a6xu2xrj.fsf@gmail.com> <20200913062858.GC1100@E5400> <87wo0hqbb3.fsf@gmail.com> <87pn5wzwcf.fsf@gnu.org> <87pn3dth0l.fsf_-_@gmail.com> <87blepaqd8.fsf_-_@gmail.com> <87sg7hxctr.fsf@gnu.org> <8735zg13c9.fsf@gmail.com> <871reysaoq.fsf@gnu.org> <87k0sjbw8w.fsf@gmail.com> Date: Sun, 31 Jan 2021 22:35:14 +0100 In-Reply-To: <87k0sjbw8w.fsf@gmail.com> (Chris Marusich's message of "Mon, 11 Jan 2021 02:31:27 -0800") Message-ID: <87lfc8kcx9.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-guix@gnu.org List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: 41669@debbugs.gnu.org, Leo Le Bouter , Maxim Cournoyer , Vincent Legoll Errors-To: bug-guix-bounces+larch=yhetil.org@gnu.org Sender: "bug-Guix" X-Migadu-Flow: FLOW_IN X-Migadu-Spam-Score: -1.36 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of bug-guix-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=bug-guix-bounces@gnu.org X-Migadu-Queue-Id: D47E69403C9 X-Spam-Score: -1.36 X-Migadu-Scanner: scn1.migadu.com X-TUID: 5RSJY5lKUGp/ Hi Chris & all, Apologies for taking so long to reply! Pinging me on IRC was the right move. :-) Chris Marusich skribis: > I'm afraid I've hit a snag using what you've uploaded, though. It looks > like we'll need to extract bash, mkdir, tar, and xz from > static-binaries-0-powerpc64le-linux-gnu.tar.xz and place a copy of each > in the following locations: > > - https://alpha.gnu.org/gnu/guix/bootstrap/powerpc64le-linux/20210106/bash > - https://alpha.gnu.org/gnu/guix/bootstrap/powerpc64le-linux/20210106/mkd= ir > - https://alpha.gnu.org/gnu/guix/bootstrap/powerpc64le-linux/20210106/tar > - https://alpha.gnu.org/gnu/guix/bootstrap/powerpc64le-linux/20210106/xz > > Could you do that? The reason why it's necessary is described below. I=E2=80=99ve uploaded these four files now. > I've started making changes locally to (gnu packages bootstrap). So > far, with the attached patch, I'm able to do the following things on my > POWER9 machine running ppc64le Debian (unstable). > > I can successfully build Guix from source using Debian packages (and a > manually-built copy of guile-avahi and guile-gnutls). With my patch, I > still have to supply the "--with-courage" configure option. Although > "make" succeeded, "make check" failed on the following tests: > > - tests/build-utils.scm > - test/challenge.scm > - tests/containers.scm > - tests/debug-link.scm > > The failures fell into two categories: > > - Some tests couldn't download the bootstrap bash. > - In tests/containers.scm, call-with-container evaluated to #f when it > wasn't supposed to. Perhaps we can investigate them later. > Nevertheless, I created the necessary build users and started the > guix-daemon via pre-inst-env. I then tried building a simple package: > > ./pre-inst-env guix build -e '(@@ (gnu packages bootstrap) %bootstrap-c= oreutils&co)' [...] > Starting download of /gnu/store/2phdifnfw6i989rqbav04zakxx7qb165-static-b= inaries-0-powerpc64le-linux-gnu.tar.xz > From https://ftp.gnu.org/gnu/guix/bootstrap/powerpc64le-linux/20210106/st= atic-binaries-0-powerpc64le-linux-gnu.tar.xz... > failed to download "/gnu/store/0kaj6l1ccw0qd0289hii7qhr828s71sv-bash" fro= m ("https://git.savannah.gnu.org/cgit/guix.git/plain/gnu/packages/bootstrap= /powerpc64le-linux/20210106/bash" "http://lilypond.org/janneke/guix/powerpc= 64le-linux/20210106/bash") > builder for `/gnu/store/ix4mpvzxfi1hrmvdmmpgqhm9x1cdh347-bash.drv' failed= to produce output path `/gnu/store/0kaj6l1ccw0qd0289hii7qhr828s71sv-bash' Note that for testing purposes, you could always work around this by adding these four files to the store with the =E2=80=98add-to-store=E2=80= =99 RPC (I don=E2=80=99t think =E2=80=98guix download=E2=80=99 would work because you = need the executable bit.) > By the way, I've noticed that the other architectures don't seem to have > "raw" binaries at all on alpha.gnu.org. Maybe you already knew this, > but it seems that the "raw" binaries are actually downloaded from this > specific URL (see the bootstrap-executable-file-name procedure): > > https://git.savannah.gnu.org/cgit/guix.git/plain/gnu/packages/bootstrap/?= id=3D44f07d1dc6806e97c4e9ee3e6be883cc59dc666e > > Is that intended? Yes: these files used to be in version control, part of the Guix source tarball, but now we just download them (commit 836a85da0e8609d40716581be00802ee43463038). > I was surprised to discover that we store these four "raw" binaries in > a totally separate place. That seems like it would make it easy for > someone to accidentally forget to update the "raw" binaries when they > update an architecture's bootstrap tarballs. They=E2=80=99re visible in the dependency graph though, and they don=E2=80= =99t need to ever change. Ludo=E2=80=99.