Re: Preservation of Guix 2021-10-22

[zimoun <zimon.toutoune@gmail.com>]

Hi Timothy,

On Sat, 23 Oct 2021 at 11:55, Timothy Sample <samplet@ngyro.com> wrote:
> zimoun <zimon.toutoune@gmail.com> writes:
>
>> How can I get the list of these 376+217 packages?  Because it appears to
>> me easy to send a save request for them. :-)

Done. :-)


> Download the database (there’s a button at the bottom of the report),
> and use SQLite to run the following queries.
>
> For the 376:
>
>     SELECT fod_id,
>         swhid,
>         reference
>     FROM fods
>         LEFT JOIN fod_references USING (fod_id)
>     WHERE NOT is_in_swh
>         AND reference LIKE '(git-reference%';
>
> For the 217 (which is the best place to start):
>
>     SELECT fod_id,
>         swhid,
>         reference
>     FROM fods
>         JOIN fod_commit_links USING (fod_id)
>         JOIN commits USING (commit_id)
>         LEFT JOIN fod_references USING (fod_id)
>     WHERE commits.hash = '258a27eea9aab4f8af995f95743ccd264b5efcb5'
>         AND NOT is_in_swh
>         AND reference LIKE '(git-reference%';

I have not checked one per one but I guess the 217 are included in the
376 ones.  As I said earlier, many of them are duplicates.

Stupid me about previous question using SWH token, I did not use the
right environment variable.  Arf!

Using something like that,

--8<---------------cut here---------------start------------->8---
(use-modules (guix swh)
             (srfi srfi-1))

(setenv "GUIX_SWH_TOKEN"
        "eyJhbG…"
        )

(define missings
  (list
   ;;"git://pumpa.branchable.com/"
   "http://genome-source.cse.ucsc.edu/samtabix.git"

[...]

   "https://salsa.debian.org/installer-team/debootstrap.git"
   ))

(for-each
 (lambda (url)
   (unless (lookup-origin url)
     (pk url)
     (save-origin url)))
 missings)
--8<---------------cut here---------------end--------------->8---

now, all the missing URLs should be ingested by SWH – modulo a couple
rejected or failed*.  It is not bullet-proof for the future – somehow it
shows that submitters and reviewers do not systematically run “guix lint
<package>” – but it should improve the POG report. :-)

I expect to have 0 missing git-reference package for the recent
revisions.  If not, please raise!


*reject or failed: I am going to ask SWH folks.


From my side, the next steps I envision is:

 1. have sources.json produced by a derivation so it could be run by CI
 2. support SVN

I need help for #1 because I am not sure to understand how to do that.
About #2, it is few packages but many packages depends on some TeX.

Cheers,
simon