Moving guix-science from GitHub?

Moving guix-science from GitHub?

[Ludovic Courtès]

Hello!

Currently Guix-Science{,-nonfree} are on GitHub, which is not great for
obvious reasons, and also because there’s no CI integration.

Thanks to Romain, Cuirass recently gained support for GitLab
integration, so it would be tempting to move to a public GitLab instance
such as gitlab.com.  One could also implement GitHub support without too
much hassle (maybe?), but is it worth it?

But if we are to migrate, we might just as well migrate to a
not-for-profit instance such as codeberg.org?  (I believe a prerequisite
for the intended audience is to have something that looks similar to
Git{Hub,Lab}, which is why I’m not suggesting the use of sr.ht.)

Thoughts?

Ludo’.

Re: Moving guix-science from GitHub?

[Simon Tournier]

Hi,

On Mon, 2 Sept 2024 at 15:42, Ludovic Courtès <ludovic.courtes@inria.fr> wrote:

> Thanks to Romain, Cuirass recently gained support for GitLab
> integration

Oh cool!  Thank you Romain.

>              so it would be tempting to move to a public GitLab instance
> such as gitlab.com

[...]

> But if we are to migrate, we might just as well migrate to a
> not-for-profit instance such as codeberg.org?

Is Cuirass also integrated with codeberg.org?  Maybe I have missed
something, from my understanding, codeberg.org depends forgejo which is
not related to Gitlab.

Well, if the motivation is to move from GitHub because of missing CI,
then the new forge must have integrated CI. ;-)

Otherwise, I do not have any opinion where the guix-science channel shoudl live.

Cheers,
simon

Re: Moving guix-science from GitHub?

[Ricardo Wurmus]

Hi,

Ludovic Courtès <ludovic.courtes@inria.fr> writes:

> Currently Guix-Science{,-nonfree} are on GitHub, which is not great for
> obvious reasons, and also because there’s no CI integration.
>
> Thanks to Romain, Cuirass recently gained support for GitLab
> integration,

Superb!

> so it would be tempting to move to a public GitLab instance
> such as gitlab.com.  One could also implement GitHub support without too
> much hassle (maybe?), but is it worth it?
>
> But if we are to migrate, we might just as well migrate to a
> not-for-profit instance such as codeberg.org?  (I believe a prerequisite
> for the intended audience is to have something that looks similar to
> Git{Hub,Lab}, which is why I’m not suggesting the use of sr.ht.)
>
> Thoughts?

I have two worries about migrating to another location:

- publications referencing a channel with URL
  https://github.com/guix-science/guix-science might break if we don't
  manage to set up a permanent redirect.

- I don't know if migration would be seamless for all users of the
  channel.  Obviously, we'd also have to update any channel that
  references guix-science (such as guix-science-nonfree).

We may also want to move guix-science-nonfree, guix-cran, and guix-bioc
while we're at it.

-- 
Ricardo

Re: Moving guix-science from GitHub?

[Konrad Hinsen]

Hi everyone,

Simon Tournier <zimon.toutoune@gmail.com> writes:

>> But if we are to migrate, we might just as well migrate to a
>> not-for-profit instance such as codeberg.org?
>
> Is Cuirass also integrated with codeberg.org?  Maybe I have missed
> something, from my understanding, codeberg.org depends forgejo which is
> not related to Gitlab.

Indeed. It does have CI:

   https://docs.codeberg.org/ci/

but it's probably not Gitlab-compatible.

But then, given that moving has a high cost (for the reasons pointed out
by Ricardo), we should take a long-term perspective. I expect forĝejo to
be a more interesting platform in the long run, both technically
(Fediverse) and socially (not for profit).

Questions:

 1. How much effort would it be to implement forĝejo support in Cuirass?

 2. In view of federated forges, which facilitate some aspects of moving
    between forges, maintaining mirrors, etc., could we come up with
    a way to make Guix channels easier to relocate, and/or have multiple
    URLs?

Cheers,
  Konrad.
-- 
---------------------------------------------------------------------
Konrad Hinsen
Centre de Biophysique Moléculaire, CNRS Orléans
Synchrotron Soleil - Division Expériences
Saint Aubin - BP 48
91192 Gif sur Yvette Cedex, France
Tel. +33-1 69 35 97 15
E-Mail: konrad DOT hinsen AT cnrs DOT fr
http://dirac.cnrs-orleans.fr/~hinsen/
ORCID: https://orcid.org/0000-0003-0330-9428
Mastodon: @khinsen@scholar.social
---------------------------------------------------------------------

Re: Moving guix-science from GitHub?

[Ludovic Courtès]

Hello,

Ricardo Wurmus <rekado@elephly.net> skribis:

>> But if we are to migrate, we might just as well migrate to a
>> not-for-profit instance such as codeberg.org?  (I believe a prerequisite
>> for the intended audience is to have something that looks similar to
>> Git{Hub,Lab}, which is why I’m not suggesting the use of sr.ht.)
>>
>> Thoughts?
>
> I have two worries about migrating to another location:
>
> - publications referencing a channel with URL
>   https://github.com/guix-science/guix-science might break if we don't
>   manage to set up a permanent redirect.

Publications that include a commit will be fine: Guix will fall back to
SWH.  You can try it for instance with:

  guix time-machine -q --url=http://example.org \
    --commit=deac7dd04156b9358ea33200593fd260760f9d91 -- \
    describe

That said, if we migrate, we should have a prominent human-readable
message at github.com if we cannot set up an actual redirect.

> - I don't know if migration would be seamless for all users of the
>   channel.  Obviously, we'd also have to update any channel that
>   references guix-science (such as guix-science-nonfree).

Right, that’s annoying and admittedly annoying.

Perhaps the repo at github.com could be in “archived” mode and still be
around though, as a way to minimize disruption for old code.

> We may also want to move guix-science-nonfree, guix-cran, and guix-bioc
> while we're at it.

Yes; we should keep them all together.

Ludo’.

Re: Moving guix-science from GitHub?

[Ludovic Courtès]

Hi,

Simon Tournier <zimon.toutoune@gmail.com> skribis:

> Is Cuirass also integrated with codeberg.org?  Maybe I have missed
> something, from my understanding, codeberg.org depends forgejo which is
> not related to Gitlab.

Cuirass doesn’t support forgejo yet.  It’s different from what GitLab
provides but very similar:

  https://forgejo.org/docs/latest/user/webhooks/

Supporting it wouldn’t be too much work.

Ludo’.

Re: Moving guix-science from GitHub?

[Ludovic Courtès]

Saluton!

Konrad Hinsen <konrad.hinsen@cnrs.fr> skribis:

> But then, given that moving has a high cost (for the reasons pointed out
> by Ricardo), we should take a long-term perspective. I expect forĝejo to
> be a more interesting platform in the long run, both technically
> (Fediverse) and socially (not for profit).

Yes, that was also my feeling.

>  1. How much effort would it be to implement forĝejo support in Cuirass?

Not too much, as I wrote.

>  2. In view of federated forges, which facilitate some aspects of moving
>     between forges, maintaining mirrors, etc., could we come up with
>     a way to make Guix channels easier to relocate, and/or have multiple
>     URLs?

Authentication and downgrade prevention make it safe to use a mirror,
and the other thing is that channels advertise their “primary URL”,
which allows you to know when you’re using a mirror (or when the channel
has moved).  And then there’s SWH fall back when a commit ID is
available.

So there are pieces in place, but it would be nice to extend that
somehow so we can gradually abstract away the actual storage location.

Thanks,
Ludo’.

Re: Moving guix-science from GitHub?

[Ludovic Courtès]

Mi ekkomprenis nur hodiaŭ la nomon “forĝejo”! :-)

Ludo’.

Re: Moving guix-science from GitHub?

[Simon Tournier]

Hi,

On Tue, 03 Sep 2024 at 09:50, Ludovic Courtès <ludovic.courtes@inria.fr> wrote:

>> - publications referencing a channel with URL
>>   https://github.com/guix-science/guix-science might break if we don't
>>   manage to set up a permanent redirect.
>
> Publications that include a commit will be fine: Guix will fall back to
> SWH.

Yes, thanks to SWH, it should work out-of-the-box.  It still needs to be
carefully checked to avoid some “mismatch” when fetching back from the
Vault.

>> - I don't know if migration would be seamless for all users of the
>>   channel.  Obviously, we'd also have to update any channel that
>>   references guix-science (such as guix-science-nonfree).

Well, from my understanding, this opens 3 kinds of concern depending on
user’s profile:

 + channel contributor: I count 14+2 Pull Requests and most of them by
   people we collaborate.  Therefore, the migration would not be too
   disruptive for them.

 + direct channel user: The main issue is to reach them.  I mean, I
   barely go to guix-science GitHub webpage.  Then, at some points “guix
   pull” will break because some packages from Guix proper will not work
   with packages from Guix-Science.  Then, the reaction depends on
   user’s skill: from let investigate what happens to bah let drop it
   because that’s still broken.

 + dependant channel user: Similarly, the main issue is to reach them.
   However, since they maintain another channel, they will check at some
   point the GitHub webpage and thus will be redirected.

IMHO, the migration cost mainly comes from “direct channel user”.

Well, maybe we could come with a mechanism in order to inform the users.

We would put this “mechanism” inside the channel.  And when running
“guix pull”, the Scheme code of the channel is “processed” so we could
display a message, somehow.  Even, we could display the new location.

Plainly said, why not update .guix-channel format and add another field?

It would remove the migration cost, or almost.

WDYT?

Cheers,
simon

Re: Moving guix-science from GitHub?

[Lars-Dominik Braun]

Hi,

> - publications referencing a channel with URL
>   https://github.com/guix-science/guix-science might break if we don't
>   manage to set up a permanent redirect.

I believe it’s not possible to set up a permanent redirect to a project
outside of GitHub. However we could use the channel news feature to
announce the move and then archive the GitHub projects.

Lars

Re: Moving guix-science from GitHub?

[Philippe SWARTVAGHER]

Le 04/09/2024 à 18:26, Lars-Dominik Braun a écrit :
> I believe it’s not possible to set up a permanent redirect to a project
> outside of GitHub. However we could use the channel news feature to
> announce the move and then archive the GitHub projects.

I was wondering: maybe ~~we~~ you could setup a mirror repository? The 
GitHub repository being a mirror of the new location of the repository. 
At least to smooth the migration in channel files.

-- 
Philippe SWARTVAGHER
Assistant Professor @ ENSEIRB-MATMECA
Research team Topal @ Inria Bordeaux-Sud Ouest

Re: Moving guix-science from GitHub?

[Cayetano Santos via Guix-Science]

>lun. 02 sept. 2024 at 15:41, Ludovic Courtès <ludovic.courtes@inria.fr> wrote:

> But if we are to migrate, we might just as well migrate to a
> not-for-profit instance such as codeberg.org?  (I believe a prerequisite
> for the intended audience is to have something that looks similar to
> Git{Hub,Lab}, which is why I’m not suggesting the use of sr.ht.)

> Thoughts?

Regarding sr.ht, let me point out that sourcehut includes support for
builds. Among others, there is a guix system build image.

    https://man.sr.ht/builds.sr.ht/compatibility.md#guix-system

Not that this is a valid option to replace GitWhatever / Codeberg (as it
departs significantly from its phylosophy), but a mirror is something to
be considered as a mid/long term alternative.

Same as emacs, by the way ;-)

    https://git.sr.ht/~emacs/emacs

Best,

C.

Re: Moving guix-science from GitHub?

[Ludovic Courtès]

Hello,

Simon Tournier <zimon.toutoune@gmail.com> skribis:

>  + direct channel user: The main issue is to reach them.  I mean, I

I think we could (1) add a news entry in Guix-Science before migrating,
and (2) change the primary URL in ‘.guix-channel’.  With these two
things, people will notice.

Ludo’.

Re: Moving guix-science from GitHub?

[Ludovic Courtès]

Philippe SWARTVAGHER <philippe.swartvagher@inria.fr> skribis:

> Le 04/09/2024 à 18:26, Lars-Dominik Braun a écrit :
>> I believe it’s not possible to set up a permanent redirect to a project
>> outside of GitHub. However we could use the channel news feature to
>> announce the move and then archive the GitHub projects.
>
> I was wondering: maybe ~~we~~ you could setup a mirror repository? The
> GitHub repository being a mirror of the new location of the
> repository. At least to smooth the migration in channel files.

Yes, I guess it’s relatively easy to do and would make the transition
smoother.

Ludo’.

Moving guix-science from GitHub to Codeberg

[Ludovic Courtès]

[-- Attachment #1: Type: text/plain, Size: 572 bytes --]

Hello Guix-Science!

Ludovic Courtès <ludovic.courtes@inria.fr> skribis:

> I think we could (1) add a news entry in Guix-Science before migrating,
> and (2) change the primary URL in ‘.guix-channel’.  With these two
> things, people will notice.

I went ahead and submitted a pull request doing just that:

  https://github.com/guix-science/guix-science/pull/43

Now’s your time to speak up if you’d prefer not to make that change, or
not now, or not this way.

If there are no objections, I’ll go ahead with this plan on Oct. 17th.

Thanks,

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 869 bytes --]

Re: Moving guix-science from GitHub to Codeberg

[Ricardo Wurmus]

Ludovic Courtès <ludovic.courtes@inria.fr> writes:

> If there are no objections, I’ll go ahead with this plan on Oct. 17th.

No objection from me.  Thanks for moving this forward.

-- 
Ricardo

Re: Moving guix-science from GitHub to Codeberg

[Lars-Dominik Braun]

Hi,

> If there are no objections, I’ll go ahead with this plan on Oct. 17th.

there’s two issues with the repo at
https://codeberg.org/guix-science/guix-science.git right now: Its
default branch is called “main” not “master”, which needs to
be specified explicitly in the channels.scm. I would just rename the
branch to match what we use right now (i.e. master). And it does not have
a keyring branch. I also cannot see who owns the new
repository/organization, but I would highly recommend granting more than
one person administrative access.

Apart from that, please go ahead.

Lars

Re: Moving guix-science from GitHub to Codeberg

[Konrad Hinsen]

Ricardo Wurmus <rekado@elephly.net> writes:

> No objection from me.  Thanks for moving this forward.

+1

Konrad.
-- 
---------------------------------------------------------------------
Konrad Hinsen
Centre de Biophysique Moléculaire, CNRS Orléans
Synchrotron Soleil - Division Expériences
Saint Aubin - BP 48
91192 Gif sur Yvette Cedex, France
Tel. +33-1 69 35 97 15
E-Mail: konrad DOT hinsen AT cnrs DOT fr
http://dirac.cnrs-orleans.fr/~hinsen/
ORCID: https://orcid.org/0000-0003-0330-9428
Mastodon: @khinsen@scholar.social
---------------------------------------------------------------------

Re: Moving guix-science from GitHub to Codeberg

[Simon Tournier]

Hi,

On Fri, 11 Oct 2024 at 07:44, Lars-Dominik Braun <lars@6xq.net> wrote:

> there’s two issues with the repo at
> https://codeberg.org/guix-science/guix-science.git right now: Its
> default branch is called “main” not “master”, which needs to
> be specified explicitly in the channels.scm. I would just rename the
> branch to match what we use right now (i.e. master). And it does not have
> a keyring branch. I also cannot see who owns the new
> repository/organization, but I would highly recommend granting more than
> one person administrative access.
>
> Apart from that, please go ahead.

I share the same words as Lars.

Cheers,
simon

Re: Moving guix-science from GitHub to Codeberg

[Ludovic Courtès]

Hi Lars,

Lars-Dominik Braun <lars@6xq.net> skribis:

>> If there are no objections, I’ll go ahead with this plan on Oct. 17th.
>
> there’s two issues with the repo at
> https://codeberg.org/guix-science/guix-science.git right now: Its
> default branch is called “main” not “master”, which needs to
> be specified explicitly in the channels.scm. I would just rename the
> branch to match what we use right now (i.e. master).

Good point.  I think at one point I thought we could change the branch
name while we’re at it, but I realize that this is too risky since right
now the ‘branch’ field of <channel> defaults to “master”.

I’ve renamed “main” to “master” now.

> And it does not have a keyring branch. I also cannot see who owns the
> new repository/organization, but I would highly recommend granting
> more than one person administrative access.

Good point!  I spent half an hour (!) trying to view the list of members
of the GitHub projects until I realized that I can’t because I’m an
“outside collaborator” on the project.  Could you (?) maybe promote me
so I can finish the work?

On Codeberg, currently only Romain and myself are members of the
guix-science org.  I would like to add all those who were already
members of the GitHub project and make sure several of them are
“owners”, and possibly add new people who’re interested in contributing.

So please everyone, email me your Codeberg account name so I can add
you.

Ludo’.

Re: Moving guix-science from GitHub to Codeberg

[Lars-Dominik Braun]

Hi,

> Good point!  I spent half an hour (!) trying to view the list of members
> of the GitHub projects until I realized that I can’t because I’m an
> “outside collaborator” on the project.  Could you (?) maybe promote me
> so I can finish the work?

you should have an invite in your mail right now.

> So please everyone, email me your Codeberg account name so I can add
> you.

“ldb”, as you can verify by looking at my GitHub-profile, which
links to that account (URL list on the left side).

Cheers,
Lars

Re: Moving guix-science from GitHub to Codeberg

[Ludovic Courtès]

Hi,

Lars-Dominik Braun <lars@6xq.net> skribis:

>> Good point!  I spent half an hour (!) trying to view the list of members
>> of the GitHub projects until I realized that I can’t because I’m an
>> “outside collaborator” on the project.  Could you (?) maybe promote me
>> so I can finish the work?
>
> you should have an invite in your mail right now.

Thanks!

Right now <https://codeberg.org/org/guix-science/> has 4 members: Lars,
Romain (who was not a member on GitHub), Simon, and myself; I’ve just
added Roel (I hope? that’s the “roelj” account, please confirm!).  Only
person missing is Ricardo.

Thanks,
Ludo’.

Re: Moving guix-science from GitHub to Codeberg

[Roel Janssen]

On Mon, 2024-10-14 at 09:28 +0200, Ludovic Courtès wrote:
> Hi,
> 
> Lars-Dominik Braun <lars@6xq.net> skribis:
> 
> > > Good point!  I spent half an hour (!) trying to view the list of
> > > members
> > > of the GitHub projects until I realized that I can’t because I’m
> > > an
> > > “outside collaborator” on the project.  Could you (?) maybe
> > > promote me
> > > so I can finish the work?
> > 
> > you should have an invite in your mail right now.
> 
> Thanks!
> 
> Right now <https://codeberg.org/org/guix-science/> has 4 members:
> Lars,
> Romain (who was not a member on GitHub), Simon, and myself; I’ve just
> added Roel (I hope? that’s the “roelj” account, please confirm!). 
> Only
> person missing is Ricardo.
> 

I can confirm, that's my account/username on Codeberg.

Kind regards,
Roel

Guix-Science channels moved to Codeberg

[Ludovic Courtès]

[-- Attachment #1: Type: text/plain, Size: 960 bytes --]

Hello!

I’m happy to report that the Guix-Science and Guix-Science-Nonfree have
been moved to Codeberg!

  https://codeberg.org/guix-science

The two GitHub repositories are now archived, meaning that they’re
read-only.

To perform the migration, I had to first remove the mirrors that we had
made at Codeberg and to start over with “New Migration” (thanks Romain
for your guidance on our first test migration!).  The repositories,
issues, and pull requests (a couple of them still open) were migrated.

It’s not entirely clear how to continue work on open pull requests (for
example: <https://codeberg.org/guix-science/guix-science/pulls/44>) but
I guess we’ll figure it out.

There are other repos at https://github.com/guix-science that we should
migrate, but there’s no rush.  If someone would like to get involved, I
can give a hand if needed (it’s pretty easy actually, thumbs up to the
Forgejo folks).

Ludo’.

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 853 bytes --]

Re: Guix-Science channels moved to Codeberg

[Ludovic Courtès]

Hi again!

Ludovic Courtès <ludo@gnu.org> skribis:

> I’m happy to report that the Guix-Science and Guix-Science-Nonfree have
> been moved to Codeberg!
>
>   https://codeberg.org/guix-science

In addition to those still at GitHub, there’s a couple of repositories
that I’d like to move under this umbrella:

  • https://gitlab.inria.fr/guix-hpc/guix-kernel

  • https://gitlab.inria.fr/guix-hpc/guix-past

The latter is not just science-y, but probably still a good fit?  At any
rate it’d benefit from being on an open public forge.

Thoughts?

Ludo’.

Re: Guix-Science channels moved to Codeberg

[Konrad Hinsen]

Ludovic Courtès <ludovic.courtes@inria.fr> writes:

> In addition to those still at GitHub, there’s a couple of repositories
> that I’d like to move under this umbrella:
>
>   • https://gitlab.inria.fr/guix-hpc/guix-kernel
>
>   • https://gitlab.inria.fr/guix-hpc/guix-past
>
> The latter is not just science-y, but probably still a good fit?  At any
> rate it’d benefit from being on an open public forge.

Indeed. And guix-past is certainly more "science" than "hpc". So: +1 !

No comment about guix-kernel, which I know nothing about.

Cheers,
  Konrad.
-- 
---------------------------------------------------------------------
Konrad Hinsen
Centre de Biophysique Moléculaire, CNRS Orléans
Synchrotron Soleil - Division Expériences
Saint Aubin - BP 48
91192 Gif sur Yvette Cedex, France
Tel. +33-1 69 35 97 15
E-Mail: konrad DOT hinsen AT cnrs DOT fr
http://dirac.cnrs-orleans.fr/~hinsen/
ORCID: https://orcid.org/0000-0003-0330-9428
Mastodon: @khinsen@scholar.social
---------------------------------------------------------------------

Re: Guix-Science channels moved to Codeberg

[Cayetano Santos]

>ven. 18 oct. 2024 at 14:45, Ludovic Courtès <ludovic.courtes@inria.fr> wrote:

> The latter is not just science-y, but probably still a good fit?  At any
> rate it’d benefit from being on an open public forge.
>
> Thoughts?

To me, the topic here is why the organisation needs to be called guix-science ?

Why not https://codeberg.org/guix-somethingelse, as an umbrella to all
guix related ? guix-whatever is sufficient to hint the reach of a given
repository.

This would limit the spread of repos over different forges, avoiding the
need for creating different accounts to future contributors.

ps. (what about gitlab.inria.fr/guix-hpc{-non-free} ?)

C.

Re: Guix-Science channels moved to Codeberg

[Ludovic Courtès]

Hey Cayetano,

Cayetano Santos <cayetano.santos@cnrs.fr> skribis:

>>ven. 18 oct. 2024 at 14:45, Ludovic Courtès <ludovic.courtes@inria.fr> wrote:
>
>> The latter is not just science-y, but probably still a good fit?  At any
>> rate it’d benefit from being on an open public forge.
>>
>> Thoughts?
>
> To me, the topic here is why the organisation needs to be called guix-science ?

This is the guix-science mailing list; this umbrella org is meant to
collect channels and tools relevant to the scientific community and less
relevant to the rest of us.  It’s a sort of special-interest group.

Perhaps it would make sense to have other such groups around Guix, but
that’s not the topic of this mailing list.  :-)

Ludo’.

Guix-Past moved to Codeberg

[Ludovic Courtès]

Hi!

I’m happy to report that I’ve successfully migrated Guix-Past from
gitlab.inria.fr to Codeberg:

  https://codeberg.org/guix-science/guix-past

I added Konrad as “collaborator”.  The people I mentioned previously are
owners of all of Guix-Science, so that extends to this repository as
well, if I’m not mistaken.

Please let me know if you had commit access to the previous repo and
would like to reinstate it.   The more, the merrier!

Ludo’.

Guix-Jupyter moved to Codeberg

[Ludovic Courtès]

New kid in the block:

  https://codeberg.org/guix-science/guix-jupyter/

There’s no rush but it’d be great if someone could take care of the 4
remaining repos at <https://github.com/guix-science/>.

Migration is super easy but it needs focus and attention to make sure
one doesn’t forget anything, especially before clicking on “Archive”.

Ludo’.