unofficial mirror of guix-devel@gnu.org 
 help / color / mirror / code / Atom feed
From: Ian Eure <ian@retrospec.tv>
To: Christopher Baines <mail@cbaines.net>
Cc: guix-devel <guix-devel@gnu.org>
Subject: Re: Static hosting of substitutes
Date: Tue, 20 Aug 2024 14:37:38 -0700	[thread overview]
Message-ID: <875xru50t1.fsf@meson> (raw)
In-Reply-To: <8734n2utg6.fsf@cbaines.net>


Christopher Baines <mail@cbaines.net> writes:

> [[PGP Signed Part:Undecided]]
> Ian Eure <ian@retrospec.tv> writes:
>
>> I’d like to provide substitutes for packages in my personal 
>> channel.
>> The ideal setup for this would be for a machine on my internal 
>> net to
>> perform the builds, then upload the results to another system 
>> on the
>> open internet.  That could be a machine running a web server 
>> pointed
>> at a directory where the NARs get uploaded, or an S3-like 
>> object
>> store, or something like that -- dirt simple, just shifting 
>> bytes off
>> disk and out a socket.
>>
>> It seems that nothing like this exists, all the public 
>> substitute
>> servers appear to use `guix publish'.  That’s not an option for 
>> me,
>> since it requires significantly more disk and compute than I 
>> have on
>> any public-facing system, and I can’t justify the cost of 
>> bigger
>> machines.
>>
>> What would it take to make a system like this work?
>
> I've run a few substitute servers like this, the required code 
> is
> actually quite simple and the build coordinator includes the 
> necessary
> bits in the form of some included hooks [1].
>
> 1: build-success-publish-hook and build-success-s3-publish-hook 
> in
> https://git.savannah.gnu.org/cgit/guix/build-coordinator.git/tree/guix-build-coordinator/hooks.scm
>
> bordeaux.guix.gnu.org used to use the build-success-publish-hook 
> to
> populate a directory with the narinfo and nar files, and NGinx 
> simply
> served this directory, although now it uses the nar-herder to 
> manage the
> nars (it still doesn't use guix publish).
>

Thank you for the pointer.  Does this integrate with Cuirass at 
all?  I have a box running cuirass and guix publish which I’m 
using for my internal builds & substitutes -- ideally, I’d like 
NARs to get uploaded to a public host when Cuirass completes a 
build.

Thanks,

  — Ian


      reply	other threads:[~2024-08-20 21:42 UTC|newest]

Thread overview: 3+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2024-08-17 22:04 Static hosting of substitutes Ian Eure
2024-08-18  8:27 ` Christopher Baines
2024-08-20 21:37   ` Ian Eure [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

  List information: https://guix.gnu.org/

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=875xru50t1.fsf@meson \
    --to=ian@retrospec.tv \
    --cc=guix-devel@gnu.org \
    --cc=mail@cbaines.net \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
Code repositories for project(s) associated with this public inbox

	https://git.savannah.gnu.org/cgit/guix.git

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).