From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp2 ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id CK4THTglnmGEmwAAgWs5BA (envelope-from ) for ; Wed, 24 Nov 2021 12:42:48 +0100 Received: from aspmx1.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp2 with LMTPS id aLTUGDglnmFkXwAAB5/wlQ (envelope-from ) for ; Wed, 24 Nov 2021 11:42:48 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 18B119412 for ; Wed, 24 Nov 2021 12:42:48 +0100 (CET) Received: from localhost ([::1]:38392 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1mpqfn-00050D-5n for larch@yhetil.org; Wed, 24 Nov 2021 06:42:47 -0500 Received: from eggs.gnu.org ([209.51.188.92]:44684) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mpqfY-0004zu-VS for guix-devel@gnu.org; Wed, 24 Nov 2021 06:42:32 -0500 Received: from [2a00:1450:4864:20::42a] (port=45993 helo=mail-wr1-x42a.google.com) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1mpqfX-0002e9-7Y for guix-devel@gnu.org; Wed, 24 Nov 2021 06:42:32 -0500 Received: by mail-wr1-x42a.google.com with SMTP id o13so3605266wrs.12 for ; Wed, 24 Nov 2021 03:42:30 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=from:to:cc:subject:in-reply-to:references:date:message-id :mime-version:content-transfer-encoding; bh=W0fQ33GH23Z+Sdc9+6amEoDff08HJ7tBWqwBfPrQroc=; b=n0oGeF5z1PRPumUvlHBkVxw0Av2dkIkJbNLd6avSIV4zW8Dd3uM+jcCfpgfMpBcuLI 8tK2QWtqdMKwCHFFWICAytTRP5JkuDIKK6mBXw8GMncx3PBzBJu6Bup22/fy+y+zdcDC SWuOUwHS3z9BmMrFnTUESZpYQjJUCD6cNu1w3p4HctPxlu5ilEC604S8EWWWYIkPeXFE BaQpFE28UcotGL8vqkm1eZMCPbVF5PAXCJOQDJQFYVEqleXyhXL9lZuhxC1iLQ561n1D +5Ug2fbZVCbCaOTSUqzmZGWgdbr6m2c7blu+aeO+sJ42IO2MEXgLRgPfUSLxjojYLfuH ujcg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:from:to:cc:subject:in-reply-to:references:date :message-id:mime-version:content-transfer-encoding; bh=W0fQ33GH23Z+Sdc9+6amEoDff08HJ7tBWqwBfPrQroc=; b=og6K33Ha9T1AxNPUsx3OXghVVponUQx9RBzYC631LZT7KqIVUZo6QtsBg9mVEfW1xC q+IpLztsrK+77z0Mfyc2u3RUEmPy6fPSV1V9++Nbw12GBe2bIR7548WSsqodCfwi7uHv Y0ZJt/7dLbO/NNiS21GHgTZ7EfIheiY2aV3t8Q1MjqwMc5iaIN4Lh4lYOoPMXFFvM9iT 7+6BLPr3Dtbce9TRqLGUgeQi+W34ktclT9UqmrO3Fm9r6oJwagvAvaMni2vLuEg7VVcX 5YBWOf+l0XQ1C5BBQFGWMUu5n3R3eAnaEbp9OutdfyQpcQxkaLE4SddVAVstPtVfknbA 7TdQ== X-Gm-Message-State: AOAM53340Jr/03uZvLc91Q5IGq1hVfsPtid+a0Nw0qV5OnvGY3/jQE2r ixGmF0bQ1Vo+MnPdmfmpDvwkCdLvTHE= X-Google-Smtp-Source: ABdhPJyfc9KN7fFiewbYx4aLVA7qk1EPWvBd5vLBJjqWSME0UJLi7Fk7pbXnTC+csIAWyHl6g91I5A== X-Received: by 2002:a05:6000:1842:: with SMTP id c2mr18265446wri.301.1637754149935; Wed, 24 Nov 2021 03:42:29 -0800 (PST) Received: from lili ([2a01:e0a:59b:9120:65d2:2476:f637:db1e]) by smtp.gmail.com with ESMTPSA id t11sm14906135wrz.97.2021.11.24.03.42.28 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 24 Nov 2021 03:42:29 -0800 (PST) From: zimoun To: Julien Lepiller , Jacob Hrbek , Liliana Marie Prikler Subject: Re: Proposal: Build timers In-Reply-To: References: Date: Wed, 24 Nov 2021 12:31:31 +0100 Message-ID: <86v90hu6wc.fsf@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Host-Lookup-Failed: Reverse DNS lookup failed for 2a00:1450:4864:20::42a (failed) Received-SPF: pass client-ip=2a00:1450:4864:20::42a; envelope-from=zimon.toutoune@gmail.com; helo=mail-wr1-x42a.google.com X-Spam_score_int: -12 X-Spam_score: -1.3 X-Spam_bar: - X-Spam_report: (-1.3 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, PDS_HP_HELO_NORDNS=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RDNS_NONE=0.793, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=no autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: "guix-devel@gnu.org" Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1637754168; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=W0fQ33GH23Z+Sdc9+6amEoDff08HJ7tBWqwBfPrQroc=; b=IFhig4PFplGBtJWZsRBNsYY19SCUrZDBOAxL/z1myibecsQi9Ft74uwZWigwvkykV5digw DH4AXSd+fmCdmsl/RC8ft90aeTz8b7Anf783znCn3gfrWdtzG2ym1E4YYyx4MyVt1OgzSR zY84aQ82w4jriCLNaIYtSYL3m3w+PCajOnDEy5d3ChW0gnNoykoQA7r5RhBWTD/PQyIK+O vPNiWdMetlX4yMJn+Ofa2NbjJEDgkZJ3qaQW3lxEuq5QH3bQnof/cNOtCQwpnzZNIEUKYJ SiG5NXaESTcipqCfxOkrKvM2osVzBIibOA6RQqPW8um3UBN7A5dTv64LX5XMdA== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1637754168; a=rsa-sha256; cv=none; b=VNCrrFcLd7dLu8s3degQFKbd2SIAkiiYrZP+jfyOfEsLTE8DzmR84SKUMWhw4k0v51l2rx bilzWuFvEfqHE4A759sjF1nzvuMNCxUc6/5S/9ZNYYYrvkVoHQDIIRIBF8fadEE/SLUN/i TwUHHyIxVOOqWxhjjMe6UFcLz3uk+CA26008T9lor2xfb09bZbKdxyfT5IUep607yjvcml 2q63zKefu7pMGq8K015fpU81SmQUnIoazgfw/o3FMLB+e2drf0S5veTj/FsoeZsNJ9VgEn TpgepPDS7QNQ1lRqq/iDHdnuEgYum+pn8zFOorSft77A+uvbLcLOXVpoLZl8bg== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=gmail.com header.s=20210112 header.b=n0oGeF5z; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Migadu-Spam-Score: -2.59 Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=gmail.com header.s=20210112 header.b=n0oGeF5z; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Migadu-Queue-Id: 18B119412 X-Spam-Score: -2.59 X-Migadu-Scanner: scn1.migadu.com X-TUID: njxkmlGDHAno Hi, On Tue, 23 Nov 2021 at 18:50, Julien Lepiller wrote: > Do we even care that much about accuracy? I don't really care that the > build takes 30 or 31 seconds, or even 1 minute, but I certainly care > whether it takes 30s or 3h. I think this is also what SBUs give you: a > rough estimate of which build is longer than the other. I think a > simple proportionality relation would work well enough in most common > cases. It might be quite off on a super computer, but who cares, > really? What if it takes 3h and the prediction says 2h? Which build is longer than the other is already provided by data in the build farm. I agree it is hard to find and one improvement could be that Cuirass or Build Coordinator exposes this data (I think it is not so easy because for instance Cuirass knows derivation and package, somehow and IIUC :-)). Who cares to know how longer it would locally take if the substitute is available*? ;-) Because at some point, this SBU should be computed. Anyway, what would be the typical error? For instance, I propose that we collectively send the timings of packages: bash, gmsh, julia, emacs, vim; or any other 5 packages for x86_64 architecture. Then we can compare typical errors between prediction and real, i.e., evaluate =E2=80=9Caccuracy=E2=80=9C for SBU and = then decide if it is acceptable or not. :-) *available: which is not the case for LFS, though. Cheers, simon