From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp11.migadu.com ([2001:41d0:403:58f0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms8.migadu.com with LMTPS id WIw3DL/KXWVeHAAA9RJhRA:P1 (envelope-from ) for ; Wed, 22 Nov 2023 10:32:47 +0100 Received: from aspmx1.migadu.com ([2001:41d0:403:58f0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp11.migadu.com with LMTPS id WIw3DL/KXWVeHAAA9RJhRA (envelope-from ) for ; Wed, 22 Nov 2023 10:32:47 +0100 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 1203843CCF for ; Wed, 22 Nov 2023 10:32:47 +0100 (CET) Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=riseup.net header.s=squak header.b=qIAcMmoq; dmarc=pass (policy=none) header.from=riseup.net; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" ARC-Seal: i=1; s=key1; d=yhetil.org; t=1700645567; a=rsa-sha256; cv=none; b=j5LACMCT7C6tQG2gL89dXyeFqaYxldr06iBsPilh4r5kIu8W4JbeTU2Ktd1T6/UBRn6sHz wpSsQV5oQD9RuZY1Zkm6QHBzheZOgL8OPHrwTl4fKIbB76bEEUxhHHSNUkTrvkNJKK2TNx CKOKK10Q6faPkmOivT0ZwtFEXN2zY2jPP5EWVdi1MXIg3G/te68k8JvNtIBiIr4twBiYvz wnwqDaeHaVsJPZyaCotzn5w/tUB4CidqzxCmjLNRNR+f5KRTQM532nQAa9adKUeB7OAjbO OBGwJT8Ql085riLf18Q/cF4s0ezb3uWqDttwnOXHvIXKNxixODPjTsl5hcGSUA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1700645567; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:in-reply-to:in-reply-to: references:references:list-id:list-help:list-unsubscribe: list-subscribe:list-post:dkim-signature; bh=9Ffa4cxm1tnlJm6YYvORvvkV80SGBhv7MO7zsM694o4=; b=kaDmsmNwLOC1ihQcyd5IHOgdloeJoScW0QlTmkdoAaSSlUE8zo7OI27tGMWmK4zuSsCQzZ C8tk90jb3QlsGQe942s23x+5fMm+fRp/LeezXa7TMCK1KexOEdkmEts9YD8HkY6o8KTV7u 4Fi0xnHlKhmVBugJdAup+VvohMLNasdf0vxonOLy1SVGnmKcZ/EGQe5bQ6fcnU9MiNi9V6 2lvVKuFwIdc07zBTBOI9U02ev3pczZ91LW+i+KzTvqSMbKQ/E7ocxVCbsc+Wn3+rs/EyPE 5pLJ6uOD/BjyoGjJZnJU+dDc7fySvjiyqYpUefdv9g3B3Tk/KVSTR37RzqUZ+A== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=riseup.net header.s=squak header.b=qIAcMmoq; dmarc=pass (policy=none) header.from=riseup.net; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1r5jaa-0005QA-8L; Wed, 22 Nov 2023 04:32:08 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1r5jaZ-0005Q2-1d for guix-devel@gnu.org; Wed, 22 Nov 2023 04:32:07 -0500 Received: from mx0.riseup.net ([198.252.153.6]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1r5jaX-000753-49 for guix-devel@gnu.org; Wed, 22 Nov 2023 04:32:06 -0500 Received: from fews01-sea.riseup.net (fews01-sea-pn.riseup.net [10.0.1.109]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by mx0.riseup.net (Postfix) with ESMTPS id 4SZwxZ2n4lz9vYJ; Wed, 22 Nov 2023 09:32:02 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=riseup.net; s=squak; t=1700645522; bh=ZHG4an5s7QaH1GLOocporGxX3gu966m0TklsaCRRlGM=; h=References:From:To:Cc:Subject:Date:In-reply-to:From; b=qIAcMmoqoO/oBWLWosjv3C90iP1HGiqCrr8jjURmeXRMnmY6j1jb/GnyCLhMXAR1F E+TIienw64F3MBF/oM2zWNZEwfAvUUvZg3RtQwQ/8r1mD696s0l4E3/4RtwG1RzF9A zPUEiiJ4xnywkdOJXtVdLPhvP5uD6eAPnbbhwpuk= X-Riseup-User-ID: 384F28D18DEEF88636F9F4DB1378DA76DCA166A22A178B0672153777D2A3F84B Received: from [127.0.0.1] (localhost [127.0.0.1]) by fews01-sea.riseup.net (Postfix) with ESMTPSA id 4SZwxY4ghBzJmqR; Wed, 22 Nov 2023 09:32:00 +0000 (UTC) References: From: Csepp To: Andy Tai Cc: guix-devel@gnu.org Subject: Re: "random check" approach to Guix QA? Date: Wed, 22 Nov 2023 10:28:13 +0100 In-reply-to: Message-ID: <874jheuoab.fsf@riseup.net> MIME-Version: 1.0 Content-Type: text/plain Received-SPF: pass client-ip=198.252.153.6; envelope-from=raingloom@riseup.net; helo=mx0.riseup.net X-Spam_score_int: -27 X-Spam_score: -2.8 X-Spam_bar: -- X-Spam_report: (-2.8 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H5=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: guix-devel-bounces+larch=yhetil.org@gnu.org X-Migadu-Flow: FLOW_IN X-Migadu-Country: US X-Migadu-Scanner: mx11.migadu.com X-Spam-Score: -6.68 X-Migadu-Queue-Id: 1203843CCF X-Migadu-Spam-Score: -6.68 X-TUID: WX/fhReypyfe Andy Tai writes: > Hi, currently Guix QA tries to rebuild all dependent packages impacted > by a change (in majority of cases updates to a new version of a > package). When there are a large number of dependent packages like > say 500 or 1000 or more, rebuilding all that takes a long time and > often the rebuild cannot complete, leaving the patch submission > dangling with no results. > > For some things where safety is important, for example import food > safety, the regulatory authority may use random check or random > sampling as a way to check for safety, in case that there is no > resource to physically check every package. > > Can the same approach be borrowed here, so when there is large number > of impacted packages from a patch, say larger than 200, Guix QA just > randomly select a subset sample out of these packages and build them, > and in case of (new) failures ask the submitter to fix the (new) > failure? And repeat this as needed. This way patches can go thru the > QA process more quickly. I think it should always do that. Assign a weight to all derivations that have to be built and choose from them randomly. Could use a combination of dependents and estimated build time to comput the weight.