From: Ian Eure <ian@retrospec.tv>
To: Christopher Baines <mail@cbaines.net>
Cc: guix-devel <guix-devel@gnu.org>
Subject: Re: Static hosting of substitutes
Date: Tue, 20 Aug 2024 14:37:38 -0700 [thread overview]
Message-ID: <875xru50t1.fsf@meson> (raw)
In-Reply-To: <8734n2utg6.fsf@cbaines.net>
Christopher Baines <mail@cbaines.net> writes:
> [[PGP Signed Part:Undecided]]
> Ian Eure <ian@retrospec.tv> writes:
>
>> I’d like to provide substitutes for packages in my personal
>> channel.
>> The ideal setup for this would be for a machine on my internal
>> net to
>> perform the builds, then upload the results to another system
>> on the
>> open internet. That could be a machine running a web server
>> pointed
>> at a directory where the NARs get uploaded, or an S3-like
>> object
>> store, or something like that -- dirt simple, just shifting
>> bytes off
>> disk and out a socket.
>>
>> It seems that nothing like this exists, all the public
>> substitute
>> servers appear to use `guix publish'. That’s not an option for
>> me,
>> since it requires significantly more disk and compute than I
>> have on
>> any public-facing system, and I can’t justify the cost of
>> bigger
>> machines.
>>
>> What would it take to make a system like this work?
>
> I've run a few substitute servers like this, the required code
> is
> actually quite simple and the build coordinator includes the
> necessary
> bits in the form of some included hooks [1].
>
> 1: build-success-publish-hook and build-success-s3-publish-hook
> in
> https://git.savannah.gnu.org/cgit/guix/build-coordinator.git/tree/guix-build-coordinator/hooks.scm
>
> bordeaux.guix.gnu.org used to use the build-success-publish-hook
> to
> populate a directory with the narinfo and nar files, and NGinx
> simply
> served this directory, although now it uses the nar-herder to
> manage the
> nars (it still doesn't use guix publish).
>
Thank you for the pointer. Does this integrate with Cuirass at
all? I have a box running cuirass and guix publish which I’m
using for my internal builds & substitutes -- ideally, I’d like
NARs to get uploaded to a public host when Cuirass completes a
build.
Thanks,
— Ian
prev parent reply other threads:[~2024-08-20 21:42 UTC|newest]
Thread overview: 3+ messages / expand[flat|nested] mbox.gz Atom feed top
2024-08-17 22:04 Static hosting of substitutes Ian Eure
2024-08-18 8:27 ` Christopher Baines
2024-08-20 21:37 ` Ian Eure [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
List information: https://guix.gnu.org/
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=875xru50t1.fsf@meson \
--to=ian@retrospec.tv \
--cc=guix-devel@gnu.org \
--cc=mail@cbaines.net \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
Code repositories for project(s) associated with this public inbox
https://git.savannah.gnu.org/cgit/guix.git
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).