From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id KPvxOkfSu15MGgAA0tVLHw (envelope-from ) for ; Wed, 13 May 2020 10:56:07 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0 with LMTPS id gNIbKFbSu14sVAAA1q6Kng (envelope-from ) for ; Wed, 13 May 2020 10:56:22 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 2D37D94001C for ; Wed, 13 May 2020 10:56:20 +0000 (UTC) Received: from localhost ([::1]:40594 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jYp3l-00059l-2F for larch@yhetil.org; Wed, 13 May 2020 06:56:21 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:53288) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1jYp3I-000571-CH for guix-devel@gnu.org; Wed, 13 May 2020 06:55:52 -0400 Received: from mail-qk1-x733.google.com ([2607:f8b0:4864:20::733]:32841) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1jYp3H-0000k1-Mb; Wed, 13 May 2020 06:55:52 -0400 Received: by mail-qk1-x733.google.com with SMTP id z80so11277801qka.0; Wed, 13 May 2020 03:55:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=A7gpfgqWJphPeNsahcHwnfASl2iRCxkbRJ9JcJdPznw=; b=A+emWteeioXkwLSsXsbwEB3SS2XisPyXodqV/otJsJ6sO2a2uEoDHmOzc/XdheVCCj e4BbsXXtTePHbkRHQ/NlRnoOXbnQcld7GDs69X2AWzFOXYNJzqV4BN4P0Nv3yl7+58d2 5k0j5hmEShDoUOlSVcMG1e9FOcZN7TkH8ybm855QuCbI/CSyVktWWeXPfip4aRpdoStl jpilp1H4cM71Wn4mij/28fIjqxbU6q89Z70eK5+wTkcWGlqyVaOFNo+zHVwzEPkALy5a 0pDdd9ZPoHLKsj+GdPmVfTRCtcUECbbwuQNyVfzKiaSO1I3ybdA9JTbgIzoH66CIebMX Kv1Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=A7gpfgqWJphPeNsahcHwnfASl2iRCxkbRJ9JcJdPznw=; b=QOAFJrXBTIjEeIV9+YZXUHIYW2So3vxT5ufbaJz6gt/ZFVUnTp3WozwUdTu8MemjUp FHJC1GvQdce1+QQgqbY0cRH8jY7rh0BBNWTjTBT9SVMg4JGIGC4EC+JrBzjVI9c2DCZQ 7Ghtro3OatZ6B6gjzxbrBbCkd5r9XLPuv+N2VS+UOE/jYeigafe7+KgszKSgCtE681xO q0UrJxkgp6h9e+xpRht+omNKgT+M3ZBiBwf1LhOgDCWRERlyDfYivkqfDU5eptGaBxTq kP5NtlUrPc5RgaPkwGdLjljtTPcZCGIKlQupGSbMEtzexB01vb0jfsEgcsDbxuSepvsN xfZg== X-Gm-Message-State: AGi0PubWg1B8rrHz9umiMTq4YFi6Zseg+gj5mt/vplYSvARELHFCaeUE 0lR/MaY2FdECPvO+v7fxPXkiui+PiVYTjEQVmCwfBMqo X-Google-Smtp-Source: APiQypL01JPNcINRtBaX4NJ/GxHpyHPZXd22afBhzzECk48qxrP1fYjVVPmj4SJpi6Gr/2m8D3hOcn/qQncnXQQ+eWI= X-Received: by 2002:a05:620a:662:: with SMTP id a2mr22691349qkh.304.1589367350122; Wed, 13 May 2020 03:55:50 -0700 (PDT) MIME-Version: 1.0 References: <492ca854398724be49d45bcf253358c17694084f.camel@aparcar.org> <87ftc4qq9l.fsf@gnu.org> In-Reply-To: <87ftc4qq9l.fsf@gnu.org> From: zimoun Date: Wed, 13 May 2020 12:55:38 +0200 Message-ID: Subject: Re: Verification Builds for Guix To: Jan Nieuwenhuizen Content-Type: text/plain; charset="UTF-8" Received-SPF: pass client-ip=2607:f8b0:4864:20::733; envelope-from=zimon.toutoune@gmail.com; helo=mail-qk1-x733.google.com X-detected-operating-system: by eggs.gnu.org: No matching host in p0f cache. That's all we know. X-Spam_score_int: 3 X-Spam_score: 0.3 X-Spam_bar: / X-Spam_report: (0.3 / 5.0 requ) BAYES_00=-1.9, DEAR_NOBODY=2.442, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001 autolearn=_AUTOLEARN X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Guix Devel , Paul Spooren Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Scanner: scn0 X-Spam-Score: 0.09 Authentication-Results: aspmx1.migadu.com; dkim=fail (rsa verify failed) header.d=gmail.com header.s=20161025 header.b=A+emWtee; dmarc=fail reason="SPF not aligned (relaxed)" header.from=gmail.com (policy=none); spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Scan-Result: default: False [0.09 / 13.00]; GENERIC_REPUTATION(0.00)[-0.53959429400633]; DWL_DNSWL_FAIL(0.00)[209.51.188.17:server fail]; R_SPF_ALLOW(-0.20)[+ip4:209.51.188.0/24:c]; FREEMAIL_FROM(0.00)[gmail.com]; R_DKIM_REJECT(1.00)[gmail.com:s=20161025]; IP_REPUTATION_HAM(0.00)[asn: 22989(0.06), country: US(-0.00), ip: 209.51.188.17(-0.54)]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:-]; MX_GOOD(-0.50)[cached: eggs.gnu.org]; MAILLIST(-0.20)[mailman]; FORGED_RECIPIENTS_MAILLIST(0.00)[]; RCVD_IN_DNSWL_FAIL(0.00)[209.51.188.17:server fail]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:22989, ipnet:209.51.188.0/24, country:US]; TAGGED_FROM(0.00)[larch=yhetil.org]; FROM_NEQ_ENVFROM(0.00)[zimontoutoune@gmail.com,guix-devel-bounces@gnu.org]; ARC_NA(0.00)[]; RCVD_COUNT_FIVE(0.00)[5]; URIBL_BLOCKED(0.00)[gnu.org:email]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; MIME_GOOD(-0.10)[text/plain]; HAS_LIST_UNSUB(-0.01)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.51.188.17:from]; FORGED_SENDER_MAILLIST(0.00)[]; DMARC_POLICY_SOFTFAIL(0.10)[gmail.com : SPF not aligned (relaxed),none] X-TUID: PzeXL0I+f04Z Dear, I do not know if it is relevant and if it completes what janneke already said. On Wed, 13 May 2020 at 08:54, Jan Nieuwenhuizen wrote: > > Checking out the packages part of the website I found that there is at > > least an CI creating binaries. Are those also offered to users? The build farm (by default) is reachable at [1] and it offers binary substitutes. Another entry point is Guix Data Service [1] which collects data about packages, builds, branches, etc.; for example the history of versions [3] or the status of builds [4]. Moreover, there is a recent proposal: build-coordinator [5]. [1] https://ci.guix.gnu.org/ [2] http://data.guix.gnu.org/ [3] https://data.guix.gnu.org/repository/1/branch/master/package/git [4] https://data.guix.gnu.org/repository/1/branch/master/package/git/output-history?output=out&system=armhf-linux&target=none [5] https://lists.gnu.org/archive/html/guix-devel/2020-04/msg00323.html > This hash includes the transitive dependencies and can be calculated > without compiling anything. The "binary package", once built, will be > installed using this hash, e.g.: > "/gnu/store/18hp7flyb3yid3yp49i6qcdq0sbi5l1n-guile-3.0.2". This hash identifies the package and the transitive dependencies, so the hash is an unique identifier (modulo hash collisions which are another story). The same hash should produce the same binary or there is source of non-determinism. That's why "guix build --check" rebuilds and compare the two builds. I do not know what is the policy on the build farm ci.guix.gnu.org about checking the rebuild. > Guix does have the "guix challenge" command > > --8<---------------cut here---------------start------------->8--- > guix challenge --help > Usage: guix challenge [PACKAGE...] > Challenge the substitutes for PACKAGE... provided by one or more servers. > > --substitute-urls=URLS > compare build results with those at URLS > --8<---------------cut here---------------end--------------->8--- > > now the trick is, to get "someone" to run that on an interesting portion > of the archive...and to report the results in some common format. I am not aware of such initiative. Which should be really cool. On the other hand, using this information of challenging the local builds against remote builds would allow to share /gnu/store/; other said full distributed substitutes mechanism. Best regards, simon