From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp12.migadu.com ([2001:41d0:8:6d80::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id 2HlYKPUD+2F/CwAAgWs5BA (envelope-from ) for ; Wed, 02 Feb 2022 23:21:41 +0100 Received: from aspmx1.migadu.com ([2001:41d0:8:6d80::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp12.migadu.com with LMTPS id gAT8JPUD+2FoUQEAauVa8A (envelope-from ) for ; Wed, 02 Feb 2022 23:21:41 +0100 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 1AE3719984 for ; Wed, 2 Feb 2022 23:21:41 +0100 (CET) Received: from localhost ([::1]:44532 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1nFO0Q-0003lJ-El for larch@yhetil.org; Wed, 02 Feb 2022 17:21:38 -0500 Received: from eggs.gnu.org ([209.51.188.92]:36398) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nFNzs-0003lB-Iw for guix-devel@gnu.org; Wed, 02 Feb 2022 17:21:04 -0500 Received: from [2a00:1450:4864:20::335] (port=35416 helo=mail-wm1-x335.google.com) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1nFNzq-0002EK-91 for guix-devel@gnu.org; Wed, 02 Feb 2022 17:21:04 -0500 Received: by mail-wm1-x335.google.com with SMTP id f80-20020a1c1f53000000b0035399b8bedcso5398767wmf.0 for ; Wed, 02 Feb 2022 14:20:55 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=from:to:subject:date:message-id:mime-version :content-transfer-encoding; bh=ZVuZKXl8OK9nkW1dfHQJOIobRQoBs9s6q9UnE37WIoY=; b=OXjlLLC+nBrBeZEZ91vuDS+Q6eMaIOQ8M03uhFk9MCwPGy8gvYIDcxw1Rk3r1KnkpM qvaCGJ3VWW++HPaO5K0uu30NSfWoqONkuEGWJt3ezoVQsRKvkZlrpjk4fEb8gNTyorNO xnHJDV/QLt7iPp5VxMJhMAET9gTTFD8hp7tkIheqztVJs2GnjXjsSznyYr2xcP6Nx613 M00j9dCyWf1f1egcbHwFFAYLgVNSn3DXEE4Db8rdyOAjL6YofOF7Ij0tTMOCYIgDws25 +Gi8vebOG6g+QDl3OevCBZ0TqoQ0y4LhgDQH0yNqVuY0m5UISt4Z47Y+5p4mbn+hf3dk cxNw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:from:to:subject:date:message-id:mime-version :content-transfer-encoding; bh=ZVuZKXl8OK9nkW1dfHQJOIobRQoBs9s6q9UnE37WIoY=; b=n8i2/xW5yBmyOlaoppG05qynbjefrELCt8lhptSxWvfBiaD419w/yF03ZQBjCpkUp3 UuWBSwCeYrFnGvj1bjl6CVUxxuNc52OhGgaLQGBr2Hy6eB2uabQYZERtcrcsxlxwAoOZ U7KcD01EJhMVlOJBL4t03wDlvRcEbp2mRVxllrEuPf1Z5maDDCGbxGBpd/NLLi1YmOjF lF8kJ8vN0ijk29UXv4O3I9/m+hR7z03N7DMYBLEOfGsoqmQqqFJjHqP1HejFGYsrBo9A qOC2CVRDnwuZhgIFJokDR9B+YuYmfDjGZdZK7TeManz604qMw2pZFgrR6oR9mDzwV5yp lEJw== X-Gm-Message-State: AOAM530/wvYPn3SS9fIQPMTjzR3MCo9Bhb0hcU6bocLCwfAfZwfAPfk3 Jq+9C5Ycq3YCq3gyID6mswfdIP9n3Kc= X-Google-Smtp-Source: ABdhPJxzxFQXlHt4keSebvjCArkPQaKXthJ3bIVGNuQYxoumehFoX0FXKrbazWsIiK4C4JZl5tClqQ== X-Received: by 2002:a05:600c:2741:: with SMTP id 1mr7953035wmw.50.1643840454047; Wed, 02 Feb 2022 14:20:54 -0800 (PST) Received: from pfiuh07 ([193.48.40.241]) by smtp.gmail.com with ESMTPSA id t18sm18844527wri.34.2022.02.02.14.20.53 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 02 Feb 2022 14:20:53 -0800 (PST) From: zimoun To: guix-devel@gnu.org Subject: failure when rebuilding the past: long term? Date: Wed, 02 Feb 2022 23:20:50 +0100 Message-ID: <87zgn89agt.fsf@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Host-Lookup-Failed: Reverse DNS lookup failed for 2a00:1450:4864:20::335 (failed) Received-SPF: pass client-ip=2a00:1450:4864:20::335; envelope-from=zimon.toutoune@gmail.com; helo=mail-wm1-x335.google.com X-Spam_score_int: -7 X-Spam_score: -0.8 X-Spam_bar: / X-Spam_report: (-0.8 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, PDS_BTC_ID=0.499, PDS_HP_HELO_NORDNS=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RDNS_NONE=0.793, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=no autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN X-Migadu-Country: US ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1643840501; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=ZVuZKXl8OK9nkW1dfHQJOIobRQoBs9s6q9UnE37WIoY=; b=hbOA0Mlze/941p3gbcCBXffCM5CeGQ+AvOg4W4bEjb+iM/iBUd+QEPwyJA/KS/x0vPJYv7 vFtluCXHOVHpw6k4HY7WQpdJO7FCvBJcfj/T4UBLWt9XWqf9lhriGnXvqSYnAnDsD/c7yJ WsNMpDw3LcXAGKc8TutlHRhkMGmUSr25CWPzoO60ME6HD2YZxQCSWvbGk7e3s9LPzg37DU drhNmDY3vytviwYwj97lSvSSBKaldNjxK2Ngb1x1HRHYkYGV6Fa5QO3V2PW8ic40QPVp36 WJ/kPDrEAWPJQPIlTOVm6nrP90Ksg1Bhoy44o0RcVre1fWpHB261o2CgtebxnA== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1643840501; a=rsa-sha256; cv=none; b=PXiR+L76usnwpuG+HkIOPYmSPC13uHrL8CMhVNP/eNxRa5DBdJcZmsKbae+2FlnckPHsDV Uc9q5bXWWvLhc7YTaCdPHY9UzGL5h6iRXmYIjjZU7M1eCUhHtUAroZj5vFRl4kQvJd08rx QWx51uLd75p5jRayyIS05EXmVmm+FBM+2IsYpmhTG9zax+/sgw9JgMLQIOmSImr/eL/Ux5 gVTgWVeym5xhpWa2FPvn1kYM5k5LTXTq/7dd1MAxVMaOWaSTRLlERGXhAEm4Qr8/pA2pLM nKUF7cYyMK6gO+eZhl4sWyNCDwi/0K7bVFLxOY8O6Bz7/hjDrtTAtjOXm/AP7g== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=gmail.com header.s=20210112 header.b=OXjlLLC+; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: -3.33 Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=gmail.com header.s=20210112 header.b=OXjlLLC+; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: 1AE3719984 X-Spam-Score: -3.33 X-Migadu-Scanner: scn1.migadu.com X-TUID: pBdig96WUIdE Hi, Investigating [0], and working on rebuilding a tiny part of "Preservation of Guix", I note some failures of the time-machine. Let just display the help message using the time-machine for all the 120 commits updating the package guix. Other said, let just check that it is possible to time-machine some commits. --8<---------------cut here---------------start------------->8--- for ci in $(git log --format=3D"%H %s" v1.0.0.. | grep 'guix: Update' | cut= -f1 -d' '); do printf "$ci "; guix time-machine --commit=3D$ci -- help 1> = /dev/null 2> /dev/null; if [ $? -eq 1 ]; then echo KO; else echo OK; fi ;do= ne --8<---------------cut here---------------end--------------->8--- These commits are failing: 7bae88b5b9dcacad4dcd11b353b486dc2f8a78e2 Sep 2021 f08587682a631d3fe30159af838c6766dd65205b Oct 2020 7db32c94b0b7d7fe0896389772f7cda802536693 Oct 2020 29d3569c9c712d70466d9175474c8fd1a3262234 Aug 2020 d3eee3c0643a20ba06941ba45d9d27146a8b634d Jul 2020 b778989e9a299102355b7145d1963baed5db7268 Mar 2020 cd2c3dc2d6ed1372ba457d7856b3fdbf097c7095 Nov 2019 7/120, not that bad! :-) However, for instance, I miss how it is possible to get: --8<---------------cut here---------------start------------->8--- @ build-started /gnu/store/9p560p4gd4f7jpbwnc8sarqkxfyxpxb9-guix-1.1.0-28.d= 27dbeb-checkout.drv - x86_64-linux /var/log/guix/drvs/9p//560p4gd4f7jpbwnc8= sarqkxfyxpxb9-guix-1.1.0-28.d27dbeb-checkout.drv.bz2 3761976 @ build-log 3761976 41 guile: warning: failed to install locale @ build-log 3761976 152 environment variable `PATH' set to `/gnu/store/378zjf2kgajcfd7mfr98jn5xyc5w= a3qv-gzip-1.10/bin:/gnu/store/sf3rbvb6iqcphgm1afbplcs72hsywg25-tar-1.32/bin' @ build-log 3761976 117 Initialized empty Git repository in /gnu/store/6ccci55npzlzb0pnpm6sf5f8swnn= rpfg-guix-1.1.0-28.d27dbeb-checkout/.git/ /@ build-log 3761976 65 fatal: dumb http transport does not support shallow capabilities @ build-log 3761976 55 Failed to do a shallow fetch; retrying a full fetch... \@ build-log 3761976 324 >From https://git.savannah.gnu.org/r/guix [...] HEAD is now at d27dbeb9d8 gnu: guix: Install OpenRC init files to $(prefix)= /etc. @ hash-mismatch /gnu/store/6ccci55npzlzb0pnpm6sf5f8swnnrpfg-guix-1.1.0-28.d= 27dbeb-checkout r:sha256 05mvljdr4clnv8i89db2hpjm33xg7jcg1vs00dbb4jcivlpkmq= rl 0j60m9s47n23flfp2yn4ww4vsk8qvp500m2x1x0ib5bjywj1hiwl hash mismatch for store item '/gnu/store/6ccci55npzlzb0pnpm6sf5f8swnnrpfg-g= uix-1.1.0-28.d27dbeb-checkout' @ build-failed /gnu/store/9p560p4gd4f7jpbwnc8sarqkxfyxpxb9-guix-1.1.0-28.d2= 7dbeb-checkout.drv - 1 hash mismatch for store item '/gnu/store/6ccci55npzl= zb0pnpm6sf5f8swnnrpfg-guix-1.1.0-28.d27dbeb-checkout' --8<---------------cut here---------------end--------------->8--- or another: --8<---------------cut here---------------start------------->8--- fatal: reference is not a tree: 537080fad8dfa63df2f1d0b0d046a28077d56a56 @ build-log 3768401 160 git-fetch: '/gnu/store/i5b1vv7qc6l2gi4xwa9mqzjy3shvgk30-git-minimal-2.28.0/= bin/git checkout 537080fad8dfa63df2f1d0b0d046a28077d56a56' failed with exit= code 128 --8<---------------cut here---------------end--------------->8--- Other said, why is time-machine fully cloning from network and not reusing '~/.cache/guix/checkouts' since it has already done earlier with =C2=ABUpdating channel 'guix' from Git repository at 'https://git.savannah.gnu.org/git/guix.git'...=C2=BB? The questions are then: 1. For these failed commits, is it fixable? If yes, how? 2. If not, what could be done to cut earlier? For instance, collect a list of commits known to be unreachable. 3. Having all the sources is one thing, but being able to rebuild is another. Failure of OpenBLAS [0] is one example, of some mesboot [1] or of texlive [2] are others. It appears to me that something is inadequate with the current workflow pushing all to master without any automated* checks. Other said, failures as 8f9fd9b70c (value "Unbound variable: ~S") (value (r-biobase) seems wrong by design. Well, ac6f677249 is another recent example. Somehow, because the package collection is becoming larger and larger (which is good!) then it is becoming harder and harder to maintain the consistency both forward and backward. For the last Guix revision, my rough estimate is that ~5% of packages are broken and my guess is that this number is =E2=80=9Cindependa= nt=E2=80=9D of the package collection size. However, I already have some collection of unreachable commits by the time-machine and then for some reachable commits, I do not have numbers for what is effectively rebuildable. As discussed in this thread [3], maybe Guix is moving too fast; or better worded, maybe the current workflow is inadequate with some goals of long term and build all from sources. I do not know=E2=80= =A6 My point here: do we provide a list of commits (release, others) where we apply more care for long term? *automated check: =E2=80=9Cguix lint=E2=80=9D is not automated since it dep= ends on the submitter and/or the committer; and for having spent some time to check the coverage of git-fetch by SWH, I can tell that =E2=80=9Cguix lint=E2=80= =9D is not automated. ;-) 0: 1: 2: 3: Cheers, simon