Re: #850644: RFP: Guix in Debian

Re: #850644: RFP: Guix in Debian

[Vagrant Cascadian]

[-- Attachment #1: Type: text/plain, Size: 3840 bytes --]

Control: block 850644 by 902174

Status update: technically working package! Needs more work within
Debian to actually include it...

On 2019-05-16, Vagrant Cascadian wrote:
> On 2018-05-16, Vagrant Cascadian wrote:
>> The main build/runtime dependencies missing from Debian appear to be
>> guile-git, and possibly a recommends on guile-ssh:
>>
>>   https://www.gnu.org/software/guix/manual/html_node/Building-from-Git.html
>>   https://www.gnu.org/software/guix/manual/html_node/Requirements.html
>
> Apparently, guix has grown a few additional dependencies since then...
>
> So in a bit of a focused run of packaging, I've been chasing the
> dependency chain necessary to get guix building on Debian:
>
> * guile-gnutls needs to be (re)enabled in libgnutls*:
>
>   https://salsa.debian.org/vagrant/gnutls

Proposed a patch to re-enable:

  https://bugs.debian.org/905272#29


> * guile-json needs to be updated to version 1.2.0 (3.x is incompatible),
>   and I've pushed wip branches updating packaging for new upstream
>   versions:
>
>   https://salsa.debian.org/debian/guile-json

Updated to 1.2.0 in Debian experimental. A little awkward not updating
to the newest upstream version, but hopefully that won't last forever...


> * I've gotten some packaging for guile-git, guile-gcrypt, guile-ssh and
>   guile-sqlite3 which need some more polish and then uploading to
>   Debian:
>
>   https://salsa.debian.org/vagrant/guile-gcrypt
>   https://salsa.debian.org/vagrant/guile-sqlite3

Uploaded and waiting in NEW for review:

  https://ftp-master.debian.org/new/guile-gcrypt_0.1.0-1.html
  https://ftp-master.debian.org/new/guile-sqlite3_0.1.0-1.html


>   https://salsa.debian.org/vagrant/guile-git

Waiting for guile-bytestructures to get through NEW.


>   https://salsa.debian.org/vagrant/guile-ssh

This is WIP, packaging needs some policy compliance issues addressed.


> * guile-git required scheme-bytestructures, which I've packaged, and
>   needs to be uploaded before guile-git can be:
>
>   https://salsa.debian.org/vagrant/scheme-bytestructures

Uploaded and waiting in NEW for review:

  https://ftp-master.debian.org/new/scheme-bytestructures_1.0.5-1.html


> After all that, I did get to the point where I could at least try to
> compile guix:
>
>   https://salsa.debian.org/vagrant/guix

With local builds of the above packages, I've got a working guix
package!

It still needs a way to get the bootstrap binaries (bash, mkdir, tar and
xz) from Guix; right now they're binaries shipped in the source!
Ludovic Courtès worked on a patch that would in theory download those at
run-time, but that is not yet working...

I tried with using symlinks to the host's bash, mkdir tar and xz, but
that resulted in the symlink getting copied into the store, which meant
that the package build environment only ended up included a dead symlink
and failed to build. Additionally, not using the exact same bootstrap
binaries means that Guix's substitute servers would produce different
results for all packages, and so substitutes wouldn't be able to be very
useful.

Bootstrapping the system with MES is also WIP in Guix, and it might be
possible to build identical bootstrap binaries using MES in Debian at
some point:

  https://bugs.debian.org/902174


The guix packaging for Debian also has a small number of test failures,
at least one of which simply needs to be disabled because it accesses
the network (which violates Debian policy).

Also needs some updates to the packaging to get the guix-daemon running
out of the box, for which there's a provided systemd service, and adding
some guixbuild users, which shouldn't be too hard.


So, still a lot to be done, but considerable progress!


live well,
  vagrant

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 227 bytes --]

Bug#850644: #850644: RFP: Guix in Debian

[Ludovic Courtès]

Hello!

Vagrant Cascadian <vagrant@debian.org> skribis:

>> After all that, I did get to the point where I could at least try to
>> compile guix:
>>
>>   https://salsa.debian.org/vagrant/guix
>
> With local builds of the above packages, I've got a working guix
> package!

Woohoo, awesome!

> It still needs a way to get the bootstrap binaries (bash, mkdir, tar and
> xz) from Guix; right now they're binaries shipped in the source!
> Ludovic Courtès worked on a patch that would in theory download those at
> run-time, but that is not yet working...

Yes, I figured this couldn’t be done on ‘master’ without entailing a
full rebuild, but I’ll see what can be done in ‘core-updates’.  To be
continued…

Congrats on all the Guile packaging work, that’s quite an achievement!

Ludo’.

Re: #850644: RFP: Guix in Debian

[Ludovic Courtès]

Hello,

Vagrant Cascadian <vagrant@debian.org> skribis:

> It still needs a way to get the bootstrap binaries (bash, mkdir, tar and
> xz) from Guix; right now they're binaries shipped in the source!
> Ludovic Courtès worked on a patch that would in theory download those at
> run-time, but that is not yet working...

On the ‘core-updates’ branch, these four files are now downloaded as
needed (they are “fixed-output derivations” at the bottom of the
dependency graph):

  https://git.savannah.gnu.org/cgit/guix.git/commit/?h=core-updates&id=836a85da0e8609d40716581be00802ee43463038

The binaries are gone from that branch.

It may be weeks before it’s merged to master, but we’re making progress!

Ludo’.

Re: #850644: RFP: Guix in Debian

[Vagrant Cascadian]

[-- Attachment #1: Type: text/plain, Size: 3004 bytes --]

On 2019-05-28, Vagrant Cascadian wrote:
> On 2019-05-16, Vagrant Cascadian wrote:
>> So in a bit of a focused run of packaging, I've been chasing the
>> dependency chain necessary to get guix building on Debian:

Summary: all the dependencies are in Debian!


>> * guile-gnutls needs to be (re)enabled in libgnutls*:
>>
>>   https://salsa.debian.org/vagrant/gnutls
>
> Proposed a patch to re-enable:
>
>   https://bugs.debian.org/905272#29

Which has since been fixed and guile-gnutls is again available in
Debian!


>> * guile-json needs to be updated to version 1.2.0 (3.x is incompatible),
>>   and I've pushed wip branches updating packaging for new upstream
>>   versions:
>>
>>   https://salsa.debian.org/debian/guile-json
>
> Updated to 1.2.0 in Debian experimental. A little awkward not updating
> to the newest upstream version, but hopefully that won't last forever...

Guix has since switched to guile-json 3.x, which is now in Debian.


>> * I've gotten some packaging for guile-git, guile-gcrypt, guile-ssh and
>>   guile-sqlite3 which need some more polish and then uploading to
>>   Debian:
>>
>>   https://salsa.debian.org/vagrant/guile-gcrypt
>>   https://salsa.debian.org/vagrant/guile-sqlite3
...
>>   https://salsa.debian.org/vagrant/guile-ssh

All Debian for a few months now!


>> * guile-git required scheme-bytestructures, which I've packaged, and
>>   needs to be uploaded before guile-git can be:
>>
>>   https://salsa.debian.org/vagrant/scheme-bytestructures
>
> Uploaded and waiting in NEW for review:
>
>   https://ftp-master.debian.org/new/scheme-bytestructures_1.0.5-1.html

scheme-bytestructures went through NEW a while back and...

The guile-git package just landed in Debian a few days ago, which was
the last missing build-dependency!


> It still needs a way to get the bootstrap binaries (bash, mkdir, tar and
> xz) from Guix; right now they're binaries shipped in the source!
> Ludovic Courtès worked on a patch that would in theory download those at
> run-time, but that is not yet working...

Since been solved in guix master branch, yay!


> Bootstrapping the system with MES is also WIP in Guix, and it might be
> possible to build identical bootstrap binaries using MES in Debian at
> some point:
>
>   https://bugs.debian.org/902174

I've made some progress on packaging MES as well, but I'm not sure we
want to wait till that's done to upload to Debian...


> The guix packaging for Debian also has a small number of test failures,
> at least one of which simply needs to be disabled because it accesses
> the network (which violates Debian policy).

The test failures seem a bit larger on this most recent pass.


> Also needs some updates to the packaging to get the guix-daemon running
> out of the box, for which there's a provided systemd service, and adding
> some guixbuild users, which shouldn't be too hard.

Working on that now...


live well,
  vagrant

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 227 bytes --]

Re: #850644: RFP: Guix in Debian

[Jan Nieuwenhuizen]

Vagrant Cascadian writes:

> On 2019-05-28, Vagrant Cascadian wrote:
>> On 2019-05-16, Vagrant Cascadian wrote:
>>> So in a bit of a focused run of packaging, I've been chasing the
>>> dependency chain necessary to get guix building on Debian:
>
> Summary: all the dependencies are in Debian!

Congratulations and thanks!  That is beautiful.

>> Bootstrapping the system with MES is also WIP in Guix, and it might be
>> possible to build identical bootstrap binaries using MES in Debian at
>> some point:
>>
>>   https://bugs.debian.org/902174
>
> I've made some progress on packaging MES as well, but I'm not sure we
> want to wait till that's done to upload to Debian...

Although GNU MES is now part of the Guix bootstrap, a regular Guix build
does not depend on mes; so I would suggest not to have guix wait for
that.  Thoughts?

Greetings,
janneke

-- 
Jan Nieuwenhuizen <janneke@gnu.org> | GNU LilyPond http://lilypond.org
Freelance IT http://JoyofSource.com | Avatar® http://AvatarAcademy.com

Re: #850644: RFP: Guix in Debian

[Christopher Baines]

[-- Attachment #1: Type: text/plain, Size: 327 bytes --]


Vagrant Cascadian <vagrant@debian.org> writes:

> On 2019-05-28, Vagrant Cascadian wrote:
>> On 2019-05-16, Vagrant Cascadian wrote:
>>> So in a bit of a focused run of packaging, I've been chasing the
>>> dependency chain necessary to get guix building on Debian:
>
> Summary: all the dependencies are in Debian!

Awesome :D

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 962 bytes --]

Re: #850644: RFP: Guix in Debian

[Diane Trout]

[-- Attachment #1: Type: text/plain, Size: 363 bytes --]

On Tue, 2019-11-12 at 20:43 -0800, Vagrant Cascadian wrote:
> On 2019-05-28, Vagrant Cascadian wrote:
> > On 2019-05-16, Vagrant Cascadian wrote:
> > > So in a bit of a focused run of packaging, I've been chasing the
> > > dependency chain necessary to get guix building on Debian:
> 
> Summary: all the dependencies are in Debian!
> 

Congratulations!

[-- Attachment #2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

Re: #850644: RFP: Guix in Debian

[Ludovic Courtès]

Hi Vagrant,

Vagrant Cascadian <vagrant@debian.org> skribis:

> On 2019-05-28, Vagrant Cascadian wrote:
>> On 2019-05-16, Vagrant Cascadian wrote:
>>> So in a bit of a focused run of packaging, I've been chasing the
>>> dependency chain necessary to get guix building on Debian:
>
> Summary: all the dependencies are in Debian!

Awesome!  Congrats and a big thank you, wooohoo!  \o/

Ludo’.