From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp11.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id CK6cGy37/WHGWwEAgWs5BA (envelope-from ) for ; Sat, 05 Feb 2022 05:21:01 +0100 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp11.migadu.com with LMTPS id cGbFGC37/WEyQQEA9RJhRA (envelope-from ) for ; Sat, 05 Feb 2022 05:21:01 +0100 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id ACC16F344 for ; Sat, 5 Feb 2022 05:21:00 +0100 (CET) Received: from localhost ([::1]:56340 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1nGCZH-0002di-RP for larch@yhetil.org; Fri, 04 Feb 2022 23:20:59 -0500 Received: from eggs.gnu.org ([209.51.188.92]:35140) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nGCZ5-0002d1-Ai for guix-devel@gnu.org; Fri, 04 Feb 2022 23:20:47 -0500 Received: from out2-smtp.messagingengine.com ([66.111.4.26]:42241) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nGCZ3-0006GR-Be for guix-devel@gnu.org; Fri, 04 Feb 2022 23:20:46 -0500 Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.nyi.internal (Postfix) with ESMTP id 01E035C010A; Fri, 4 Feb 2022 23:20:43 -0500 (EST) Received: from mailfrontend2 ([10.202.2.163]) by compute4.internal (MEProxy); Fri, 04 Feb 2022 23:20:43 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:cc:content-transfer-encoding :content-type:date:date:from:from:in-reply-to:message-id :mime-version:references:reply-to:sender:subject:subject:to:to :x-me-proxy:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s= fm2; bh=NwjVFJ3RFuKCOgLVFH7+LSNGwisReF6q9SjYydwY37w=; b=KJaH2RKb pKR0lte5C+lowUXLGmpka6STDMmz9WRlQiAggym2i0vmuqWPNG+usRQtOwEYYO/v 9V+zmShCi9JhsbB80o661dBcVAih82KqTgUy7NaL3plUJP4CAcXJqvE3Th5jPavo C/Tr8DmjwmxnhnbaBBb84wuIt+co0GJYlREXsW1c99n7WlOKGz10ab/rB7JZ6IA4 Hr7tYT4WWhU7Y07yxOf0gAnuweXKu2iXRdwWWk25yRC/N4CS2h739PM02YOYWw7c n5aasA8Qdm6cq8ezqYEz4EerqEWk02Xg/wRSApMDjZU+Q8niK7NU1ApH49D8f1dO oTU4aukkIyh/LQ== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvvddrhedtgdeilecutefuodetggdotefrodftvf curfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfghnecu uegrihhlohhuthemuceftddtnecusecvtfgvtghiphhivghnthhsucdlqddutddtmdenuc fjughrpefhvffufhffkfgfgggtgfesthhqredttderjeenucfhrhhomhepvfhimhhothhh hicuufgrmhhplhgvuceoshgrmhhplhgvthesnhhghihrohdrtghomheqnecuggftrfgrth htvghrnhepleejueevhfevudffkeevueefvefgfeefledttdeiueeikefhveejjeejiefh geefnecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhepsh grmhhplhgvthesnhhghihrohdrtghomh X-ME-Proxy: Received: by mail.messagingengine.com (Postfix) with ESMTPA; Fri, 4 Feb 2022 23:20:42 -0500 (EST) From: Timothy Sample To: zimoun Subject: Re: missing patch for texlive-bin (e77412362f) References: <875ypx9kki.fsf@gmail.com> <0711363a0e331db1e7bf94bc71daad69ba840f99.camel@telenet.be> <87sft054wm.fsf@ngyro.com> <86ee4jzsur.fsf@gmail.com> Date: Fri, 04 Feb 2022 23:20:41 -0500 Message-ID: <871r0i54h2.fsf@ngyro.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Received-SPF: pass client-ip=66.111.4.26; envelope-from=samplet@ngyro.com; helo=out2-smtp.messagingengine.com X-Spam_score_int: -25 X-Spam_score: -2.6 X-Spam_bar: -- X-Spam_report: (-2.6 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Guix Devel Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN X-Migadu-Country: US ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1644034861; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: references:references:list-id:list-help:list-unsubscribe: list-subscribe:list-post:dkim-signature; bh=NwjVFJ3RFuKCOgLVFH7+LSNGwisReF6q9SjYydwY37w=; b=SN4WO712OhfneQn2M4M5y2Cod8rNJZAbG70LH4KRI/Tgp2SmL4mhhexlpy4utpjt6+ri3P 5u5unnuXFgvay+WJieGDsL8kvCviHISGmgUfGPJIHWRSDLpTFqFTcrYO8d+ykXbQWvt8qD 6smVO248me1eXeJYOXOk8v+JS8R/RI/0WDhVP5qE9mz55K/7la9xxkG6zjAqex6JnnpI7z oy0p7RxLTe2/C8DkNSFPr6LRVLCk+Ehr3m6yHQ4UxXkUJao22NBobl8ELmf06DMMsjLZTG YXcMpUGec2A69wHsxeMhA6lKPr3WMpZsZOA5vmCsGnhdpJblMzcsAyjC8iB0fw== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1644034861; a=rsa-sha256; cv=none; b=VlcdWqwYNv1r2hrPSw9GYrpVx7crQ9Ur43Yjy3d/BfBEP+u+TxG4mY8Pk/R14N5cUEnYa9 X+UZA+voEczCd9e7vVmE5aFcGU34NqqtRHawY21cM9sgdsaK/PMdfmmoVGuKTCr6uiXDC1 CNSPEm/f9NDys8IgRcBeLs1Qs0cM8lJ/RXf2NuR9Hn0gsG+dxFtkCY/+lXySxGhk1Kwemx 7bKSt689vRXVe0evoNVUiHw/deEhxxW0DUAnHtbWdLk0PLOqQTyKQm2yR4XRavWncU3j4t v6L8wgQXkYyhoxZ9Y2l0FvwhVr9m6iOvn6Txhf/xZT2O8vGqqZyGLfIDsVLg8A== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=messagingengine.com header.s=fm2 header.b=KJaH2RKb; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: -2.53 Authentication-Results: aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=messagingengine.com header.s=fm2 header.b=KJaH2RKb; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: ACC16F344 X-Spam-Score: -2.53 X-Migadu-Scanner: scn0.migadu.com X-TUID: /RvxtRVZZ+Lw Hi, zimoun writes: > On Thu, 03 Feb 2022 at 10:46, Timothy Sample wrote: > >> The bad news is that 0.75 is not there. At first I was going to >> apologize for the shortcomings of the sampling approach... until I >> realized you are trying to trick me! ;) Unless I=E2=80=99m misreading = the Git >> history, that patch appeared and disappeared on core-updates and was >> never part of master. > > Because of the good news, the same could be applied for these patches, > no? [...] [I]t =E2=80=9Conly=E2=80=9D misses to dissamble this data and = add an entry > to the database, no? Yes. I could add that commit to the database, evaluate it, and load all the sources. I=E2=80=99m inclined not to, but I=E2=80=99m open to being co= nvinced. (I really like how simple the current system is conceptually.) > I miss what you mean by =C2=ABwas never part of master=C2=BB. After the = merge, > what was core-updates and what was master is somehow indistinguishable, > no? Or are you walking only to first-parent after merge commit? Well, > Git history and sorting leads to headache; as git-log doc shows. :-) > > I think it is fine to simplify =E2=80=9Ccomplex=E2=80=9D history with a s= ampling > considering only first-parent walk. That=E2=80=99s about it. To my mind, =E2=80=9CThe History of the Guix Pack= age Database=E2=80=9D *is* the first parent walk that you describe. Of course, that=E2=80=99s ju= st my feeling. There=E2=80=99s lots of room for disagreement there. Basically, = if you can=E2=80=99t reach a commit by starting at 1.0.0 and running =E2=80=98= guix pull=E2=80=99 without arguments, it doesn=E2=80=99t exist! >> That being said, coverage is not perfect. The most obvious problem (to >> me) is the sampling approach. Surely there are sources that are missed >> by only examining one commit per week. This can be checked and fixed by >> using data from the Guix Data Service, which has data from essentially >> every Guix commit. > > No, the Data Service and even Cuirass are using a sampling approach too; > they do not process all the commits. > > Cuirass uses a =C2=ABevery 5 minutes=C2=BB approach; please CI savvy peop= le > correct me if I mistake. The Data Service uses a =C2=ABbatch guix-commit= s=C2=BB > approach; more details in this thread [1]. Thanks for letting me know about this. Maybe I=E2=80=99m too optimistic! Either way, the Data Service data is likely much more accurate than PoG, and could still help build confidence. > Well, the coverage is twofold, IMHO. > > 1. preserve what is currently entering in Guix > 2. archive what was available in Guix > > About #1, the main mechanism are sources.json, =E2=80=9Cguix lint=E2=80= =9D, and update > disarchive-db (now done by CI). What is missed should be fixed by #2. > > About #2, it is hard to fix all the issues at once. One commit per week > already provides a good view to spot some problems. Somehow, process > all the commits just means burn more CPU; it seems =E2=80=9Ceasy=E2=80=9D= once the > infrastructure is in-place, no? More or less. Burning CPU is definitely the main thing holding back processing all the commits, but it would likely take a bit of effort to get code that works for around one hundred commits to work for thousands. The second thing is diminishing returns. Burning *way* more CPU to track down a couple sources feels a little wasteful to me. For me, the scope of PoG is perfect the way it is. It=E2=80=99s big enough= to be useful, but not so big to be overwhelming. There are lots of serious problems to be addressed, too. That being said, I=E2=80=99m willing to change things. A lot of this is ju= st my gut feeling. :) If everyone else is clamouring to have more commits or to track core-updates or whatever, I=E2=80=99m all ears! -- Tim