From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id wDk5Npskr15KQAAA0tVLHw (envelope-from ) for ; Sun, 03 May 2020 20:07:55 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0 with LMTPS id yLyxMqUkr15deAAA1q6Kng (envelope-from ) for ; Sun, 03 May 2020 20:08:05 +0000 Received: from lists.gnu.org (lists.gnu.org [IPv6:2001:470:142::17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id B9E519440E5 for ; Sun, 3 May 2020 20:08:04 +0000 (UTC) Received: from localhost ([::1]:51102 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jVKuD-00044L-3Z for larch@yhetil.org; Sun, 03 May 2020 16:08:05 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:39604) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1jVKu3-000447-BS for guix-devel@gnu.org; Sun, 03 May 2020 16:07:55 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]:59221) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jVKu2-0002Pa-AT; Sun, 03 May 2020 16:07:54 -0400 Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=49816 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1jVKu1-0008BG-I7; Sun, 03 May 2020 16:07:53 -0400 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: Christopher Baines Subject: Re: Medium-term road map References: <87mu6zd6tz.fsf@gnu.org> <875zdmnm6q.fsf@cbaines.net> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 15 =?utf-8?Q?Flor=C3=A9al?= an 228 de la =?utf-8?Q?R?= =?utf-8?Q?=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Sun, 03 May 2020 22:07:50 +0200 In-Reply-To: <875zdmnm6q.fsf@cbaines.net> (Christopher Baines's message of "Sun, 26 Apr 2020 19:20:29 +0100") Message-ID: <87a72oye7d.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.3 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: guix-devel@gnu.org Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Scanner: scn0 X-Spam-Score: -0.30 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 2001:470:142::17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Scan-Result: default: False [-0.30 / 13.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; GENERIC_REPUTATION(0.00)[-0.4938799447623]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2001:470:142::/48:c]; IP_REPUTATION_HAM(0.00)[asn: 22989(0.14), country: US(-0.00), ip: 2001:470:142::17(-0.49)]; DWL_DNSWL_FAIL(0.00)[2001:470:142::17:server fail]; MX_GOOD(-0.50)[cached: eggs.gnu.org]; RCPT_COUNT_TWO(0.00)[2]; MAILLIST(-0.20)[mailman]; FORGED_RECIPIENTS_MAILLIST(0.00)[]; RCVD_IN_DNSWL_FAIL(0.00)[2001:470:142::17:server fail]; MIME_TRACE(0.00)[0:+]; R_MIXED_CHARSET(0.71)[subject]; ASN(0.00)[asn:22989, ipnet:2001:470:142::/48, country:US]; R_DKIM_NA(0.00)[]; TAGGED_FROM(0.00)[larch=yhetil.org]; ARC_NA(0.00)[]; RCVD_COUNT_FIVE(0.00)[5]; FROM_NEQ_ENVFROM(0.00)[ludo@gnu.org,guix-devel-bounces@gnu.org]; FROM_HAS_DN(0.00)[]; URIBL_BLOCKED(0.00)[gnu.org:url,cbaines.net:email]; MID_RHS_MATCH_FROM(0.00)[]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[gnu.org]; HAS_LIST_UNSUB(-0.01)[]; FORGED_SENDER_MAILLIST(0.00)[] X-TUID: ywf+Ysjrgcu0 Hey! Christopher Baines skribis: > zimoun writes: > >> 2. Search on all the packages included in Guix since the Big Bang. >> >> It is difficult to find the Guix commit where one package goes in and >> the commit where it goes out. The Guix Data Service (GDS) helps a lot >> for that! But AFAIK, it is not possible from the CLI and I do not find >> it handy when I need it (just because I need to open a webbrowser, >> etc.). >> >> IMHO, there is 3 questions: >> - how to build such full historical index locally? Even if it is expens= ive >> - how to fetch it from GDS? Or any other substitue? > > It's far from "the Big Bang", but the data.guix.gnu.org instance of the > Guix Data Service has data going back to the start of 2019, with some > big gaps that are still being filled in. Once that's happened, it'll be > feasible to start looking at going further back. > > On your point about fetching data, the Guix Data Service can return data > in JSON, and it's been mentioned that there could be something like the > (guix ci) module, but to access the Guix Data Service. Once the data is > available, it would at least be feasible to use that for a command line > interface. Yup, that=E2=80=99s the most practical approach. We could write a program to build a database locally (I very much like the idea of =E2=80=9Csubstitutes=E2=80=9D viewed as an optimization compare= d to local computation) but that would be expensive, although it could be incremental. I suppose we could reuse relevant bits of the Data Service as a library. Hmm thinking about it, by building the package-cache derivation of each Guix revision, one already gets a lot of information, and that is substitutable. Food for thought! Ludo=E2=80=99.