Arun Isaac Presentation on guix-forge this Saturday

Arun Isaac Presentation on guix-forge this Saturday

[jgart]

hi guixers!

I'd like to invite you this Saturday to a presentation on guix-forge by Arun Isaac:

https://guix-forge.systemreboot.net/

guix-forge empowers users to bring their own forge (BYOF). It's a much
needed project with an design focus on statelessness and minimalism.

Arun will be presenting on guix-forge this Saturday at 16:00 UTC.

Here's the room invite link:

https://meet.nixnet.services/b/jga-nze-hgu-1qg

hope to see ya there,

jgart

https://whereis.みんな/
https://litterbox.whereis.みんな/

Re: Arun Isaac Presentation on guix-forge this Saturday

[Tobias Geerinckx-Rice]

[-- Attachment #1: Type: text/plain, Size: 180 bytes --]

jgart 写道：
> I'd like to invite you this Saturday to a presentation on 
> guix-forge by Arun Isaac:

Magical: I can probably make it this time.

Kind regards,

T G-R

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 247 bytes --]

Re: Arun Isaac Presentation on guix-forge this Saturday

[jgart]

On Wed, 25 May 2022 01:45:07 +0200 Tobias Geerinckx-Rice <me@tobias.gr> wrote:
> jgart 写道：
> > I'd like to invite you this Saturday to a presentation on 
> > guix-forge by Arun Isaac:
> 
> Magical: I can probably make it this time.
> 
> Kind regards,
> 
> T G-R

Glad to hear you'll make it.

till Sat,

jgart

Re: Arun Isaac Presentation on guix-forge this Saturday

[Pjotr Prins]

Guix-forge aims to replace github and gitlab. I don't know how much
Arun will show, but I would like to note that under their guidance we
have replaced the github issue trackers, kanban boards, and CI for the
genenetwork project.

https://ci.genenetwork.org/

https://issues.genenetwork.org/

In all it is *much* nicer to work with.

We still have github as a backend for most git repos, but the main
thing is that we are not delivered to github functionality and may
move off to gitea or cgit any time:

https://git.genenetwork.org/

Important stuff!

Pj.

On Tue, May 24, 2022 at 06:26:56PM -0500, jgart wrote:
> hi guixers!
> 
> I'd like to invite you this Saturday to a presentation on guix-forge by Arun Isaac:
> 
> https://guix-forge.systemreboot.net/
> 
> guix-forge empowers users to bring their own forge (BYOF). It's a much
> needed project with an design focus on statelessness and minimalism.
> 
> Arun will be presenting on guix-forge this Saturday at 16:00 UTC.
> 
> Here's the room invite link:
> 
> https://meet.nixnet.services/b/jga-nze-hgu-1qg
> 
> hope to see ya there,
> 
> jgart
> 
> https://whereis.みんな/
> https://litterbox.whereis.みんな/
> 
> 

Re: Arun Isaac Presentation on guix-forge this Saturday

[Blake Shaw]

[-- Attachment #1: Type: text/plain, Size: 1508 bytes --]

Wow this is incredible, can't wait to hear about it!

On Wed, May 25, 2022, 13:50 Pjotr Prins <pjotr.public12@thebird.nl> wrote:

> Guix-forge aims to replace github and gitlab. I don't know how much
> Arun will show, but I would like to note that under their guidance we
> have replaced the github issue trackers, kanban boards, and CI for the
> genenetwork project.
>
> https://ci.genenetwork.org/
>
> https://issues.genenetwork.org/
>
> In all it is *much* nicer to work with.
>
> We still have github as a backend for most git repos, but the main
> thing is that we are not delivered to github functionality and may
> move off to gitea or cgit any time:
>
> https://git.genenetwork.org/
>
> Important stuff!
>
> Pj.
>
> On Tue, May 24, 2022 at 06:26:56PM -0500, jgart wrote:
> > hi guixers!
> >
> > I'd like to invite you this Saturday to a presentation on guix-forge by
> Arun Isaac:
> >
> > https://guix-forge.systemreboot.net/
> >
> > guix-forge empowers users to bring their own forge (BYOF). It's a much
> > needed project with an design focus on statelessness and minimalism.
> >
> > Arun will be presenting on guix-forge this Saturday at 16:00 UTC.
> >
> > Here's the room invite link:
> >
> > https://meet.nixnet.services/b/jga-nze-hgu-1qg
> >
> > hope to see ya there,
> >
> > jgart
> >
> > https://whereis.みんな/ <https://whereis.xn--q9jyb4c/>
> > https://litterbox.whereis.みんな/ <https://litterbox.whereis.xn--q9jyb4c/>
> >
> >
>
>

[-- Attachment #2: Type: text/html, Size: 2543 bytes --]

Re: Arun Isaac Presentation on guix-forge this Saturday

[Arun Isaac]

Hi all,

Thanks for giving me this opportunity to present guix-forge. In
particular, I wish to thank both jgart and Pjotr. guix-forge owes its
existence to their encouragement.

guix-forge is a Guix service that, ambitiously, tries to reproduce a
sourcehut, GitHub or GitLab like code forge, but using only
off-the-shelf components like cgit, laminar, public-inbox, etc. The idea
is to enable users to write a few lines of Guix operating-system
configuration code, and have an entire code forge deployed and
ready. guix-forge is similar to projects like FreedomBox, YunoHost and
Mail-in-a-Box, but for code forges and built on the rock-solid
foundation that is Guix.

For now, only the laminar CI feature is in place. In the presentation, I
will show a setup of laminar CI with guix-forge. On every git commit to
a project repo, the CI will
- automatically run tests for the project
- build and deploy a static project website

If you would like to take a sneak peek of a guix-forge configuration,
there is a simple example in the Tutorial section of the manual at
https://guix-forge.systemreboot.net/manual/dev/en/

For a more complex real world configuration that, among other things,
does continuous deployment of a web service, you can look at the
guix-forge configuration for genenetwork.org at
https://git.genenetwork.org/arunisaac/genenetwork-machines . The Laminar
CI deployed by this configuration is at https://ci.genenetwork.org/

Thanks,
Arun

Re: Arun Isaac Presentation on guix-forge this Saturday

[Ludovic Courtès]

Hello Arun!

Too bad I missed the event on Saturday.

Arun Isaac <arunisaac@systemreboot.net> skribis:

> guix-forge is a Guix service that, ambitiously, tries to reproduce a
> sourcehut, GitHub or GitLab like code forge, but using only
> off-the-shelf components like cgit, laminar, public-inbox, etc. The idea
> is to enable users to write a few lines of Guix operating-system
> configuration code, and have an entire code forge deployed and
> ready. guix-forge is similar to projects like FreedomBox, YunoHost and
> Mail-in-a-Box, but for code forges and built on the rock-solid
> foundation that is Guix.

This is really nice.  I like the idea of having easy deployment through
a Guix service, and of composing existing tools.  (It’d even be worth a
blog post, hint hint ;-))

> For now, only the laminar CI feature is in place. In the presentation, I
> will show a setup of laminar CI with guix-forge. On every git commit to
> a project repo, the CI will
> - automatically run tests for the project
> - build and deploy a static project website
>
> If you would like to take a sneak peek of a guix-forge configuration,
> there is a simple example in the Tutorial section of the manual at
> https://guix-forge.systemreboot.net/manual/dev/en/
>
> For a more complex real world configuration that, among other things,
> does continuous deployment of a web service, you can look at the
> guix-forge configuration for genenetwork.org at
> https://git.genenetwork.org/arunisaac/genenetwork-machines . The Laminar
> CI deployed by this configuration is at https://ci.genenetwork.org/

Neat.  I wonder if there could be a more Guiley flavor of guix-forge,
for instance with Gitile instead of Cgit and mumi instead of
public-inbox (though these two are not quite equivalent).

Thanks for sharing!

Ludo’.

Re: Arun Isaac Presentation on guix-forge this Saturday

[Arun Isaac]

Hi Ludo,

> This is really nice.  I like the idea of having easy deployment through
> a Guix service, and of composing existing tools.  (It’d even be worth a
> blog post, hint hint ;-))

He he, I'm getting the hint! ;-) Maybe, I'll write a blog post when
guix-forge is a little bit more featureful! :-)

> I wonder if there could be a more Guiley flavor of guix-forge, for
> instance with Gitile instead of Cgit

I have added gitile, klaus and other git web viewers to my agenda. I'm
sure everyone will have their favorite git web viewer. So, it'll be good
to cater to a wider range of tastes. Besides, it's really easy to
support multiple read-only git web viewers. Patches welcome! ;-)

Also, I'm thinking parts of guix-forge can be gradually merged into Guix
itself. The webhook-service-type in guix-forge is already a good
candidate with wider use cases than just guix-forge.

> mumi instead of public-inbox (though these two are not quite
> equivalent).

Mumi is tricky to deploy since it is not standalone and requires being
on a special IP allowlist with the Debbugs GNU servers. If mumi could be
augmented to not need a Debbugs server at all, then it would become much
more attractive.

> Thanks for sharing!

Thanks for inventing Guix and making guix-forge inevitable! :-)

Regards,
Arun

Re: Arun Isaac Presentation on guix-forge this Saturday

[jgart]

On Mon, 30 May 2022 17:55:27 +0200 Ludovic Courtès <ludo@gnu.org> wrote:
Hi Guixers!

Below is an updated link that actually shows Arun's screenshare:

https://archive.org/details/arun-isaac-guix-forge-may-28

Let me know if you run into any issues. 

I recommend downloading it from archive.org for local viewing as
archive.org tends to struggle with streaming it.

all best,

jgart

https://whereis.みんな/

Re: Arun Isaac Presentation on guix-forge this Saturday

[jgart]

On Mon, 30 May 2022 14:31:12 -0500 jgart <jgart@dismail.de> wrote:
> On Mon, 30 May 2022 17:55:27 +0200 Ludovic Courtès <ludo@gnu.org> wrote:
> Hi Guixers!
> 
> Below is an updated link that actually shows Arun's screenshare:
> 
> https://archive.org/details/arun-isaac-guix-forge-may-28

Other link had no audio ;()

Here's the latest one:

https://archive.org/details/arun-isaac-on-guix-forge

Re: Arun Isaac Presentation on guix-forge this Saturday

[Christine Lemmer-Webber]

Ludovic Courtès <ludo@gnu.org> writes:

> Hello Arun!
>
> Too bad I missed the event on Saturday.
>
> Arun Isaac <arunisaac@systemreboot.net> skribis:
>
>> guix-forge is a Guix service that, ambitiously, tries to reproduce a
>> sourcehut, GitHub or GitLab like code forge, but using only
>> off-the-shelf components like cgit, laminar, public-inbox, etc. The idea
>> is to enable users to write a few lines of Guix operating-system
>> configuration code, and have an entire code forge deployed and
>> ready. guix-forge is similar to projects like FreedomBox, YunoHost and
>> Mail-in-a-Box, but for code forges and built on the rock-solid
>> foundation that is Guix.
>
> This is really nice.  I like the idea of having easy deployment through
> a Guix service, and of composing existing tools.  (It’d even be worth a
> blog post, hint hint ;-))
>
>> For now, only the laminar CI feature is in place. In the presentation, I
>> will show a setup of laminar CI with guix-forge. On every git commit to
>> a project repo, the CI will
>> - automatically run tests for the project
>> - build and deploy a static project website
>>
>> If you would like to take a sneak peek of a guix-forge configuration,
>> there is a simple example in the Tutorial section of the manual at
>> https://guix-forge.systemreboot.net/manual/dev/en/
>>
>> For a more complex real world configuration that, among other things,
>> does continuous deployment of a web service, you can look at the
>> guix-forge configuration for genenetwork.org at
>> https://git.genenetwork.org/arunisaac/genenetwork-machines . The Laminar
>> CI deployed by this configuration is at https://ci.genenetwork.org/
>
> Neat.  I wonder if there could be a more Guiley flavor of guix-forge,
> for instance with Gitile instead of Cgit and mumi instead of
> public-inbox (though these two are not quite equivalent).
>
> Thanks for sharing!
>
> Ludo’.

And cuirass? :)

Re: Arun Isaac Presentation on guix-forge this Saturday

[zimoun]

Hi,

On mar., 24 mai 2022 at 18:26, jgart <jgart@dismail.de> wrote:

> https://meet.nixnet.services/b/jga-nze-hgu-1qg

Cool!  Is it planned to record?

(Well, real life is what it is, I have some constraints on the slot and
I would like to know if I have to try hard to free this slot. :-))


Cheers,
simon

Re: Arun Isaac Presentation on guix-forge this Saturday

[jgart]

On Wed, 25 May 2022 11:07:39 +0200 zimoun <zimon.toutoune@gmail.com> wrote:
> Hi,
> 
> On mar., 24 mai 2022 at 18:26, jgart <jgart@dismail.de> wrote:
> 
> > https://meet.nixnet.services/b/jga-nze-hgu-1qg
> 
> Cool!  Is it planned to record?

Hi,

Yes, I'll record it with Big Blue Button and release it afterwards.

Re: Arun Isaac Presentation on guix-forge this Saturday

[Olivier Dion via Development of GNU Guix and the GNU System distribution.]

On Tue, 24 May 2022, jgart <jgart@dismail.de> wrote:
> hi guixers!
>
> I'd like to invite you this Saturday to a presentation on guix-forge by Arun Isaac:
>
> https://guix-forge.systemreboot.net/

Quick question about guix-forge.  Why laminar instead of cuirass as the CI?

-- 
Olivier Dion
oldiob.dev

Re: Arun Isaac Presentation on guix-forge this Saturday

[Arun Isaac]

Hi Olivier,

> Quick question about guix-forge.  Why laminar instead of cuirass as
> the CI?

Two reasons:

- Cuirass requires a PostgreSQL database, but I wanted guix-forge to be
  as stateless as possible and definitely not require a complex database
  server like PostgreSQL. Laminar just uses sqlite.
  
- Laminar is very minimal and easy to deploy. Long back when I tried
  cuirass, I couldn't really figure out how to run it for general
  purpose CI. Maybe, the manual has improved since then, but I haven't
  checked.

Cheers!
Arun

Re: Arun Isaac Presentation on guix-forge this Saturday

[Olivier Dion via Development of GNU Guix and the GNU System distribution.]

On Thu, 26 May 2022, Arun Isaac <arunisaac@systemreboot.net> wrote:
> Hi Olivier,
>
>> Quick question about guix-forge.  Why laminar instead of cuirass as
>> the CI?
>
> Two reasons:
>
> - Cuirass requires a PostgreSQL database, but I wanted guix-forge to be
>   as stateless as possible and definitely not require a complex database
>   server like PostgreSQL. Laminar just uses sqlite.

Right.  This is something that's also bothering me.  I wonder how hard
it would be to select the database used by cuirass at runtime.
   
> - Laminar is very minimal and easy to deploy. Long back when I tried
>   cuirass, I couldn't really figure out how to run it for general
>   purpose CI. Maybe, the manual has improved since then, but I haven't
>   checked.

I did found the manual to be lacking.  I'm using it just to re-compile
my local package though so it's enough.

Tell me, does Laminar check for channels update like cuirass?  The main
feature I like about cuirass is that if any dependencies of a package is
updated, it will rebuild my package.  If it does support that, I will
seriously consider switching to guix-forge for my project.

-- 
Olivier Dion
oldiob.dev

Re: Arun Isaac Presentation on guix-forge this Saturday

[Arun Isaac]

Hi Olivier,

> Tell me, does Laminar check for channels update like cuirass?  The main
> feature I like about cuirass is that if any dependencies of a package is
> updated, it will rebuild my package.  If it does support that, I will
> seriously consider switching to guix-forge for my project.

Short answer: No, laminar/guix-forge don't rerun CI jobs when package
dependencies change.

Long answer:

It should be possible to configure laminar to do something like that.

Laminar has a very minimalist Unix-philosophy design and does not even
automatically trigger CI jobs on git commits. The user has to manually
set up a post-receive hook in the git repository that runs `laminarc
queue <job-name>'. guix-forge automatically handles this post-receive
hook setup for you. So, though I don't immediately see how to do it, it
should be possible to set up something that runs `laminarc queue
<job-name>' on dependency changes.

Laminar stands out from other CI systems in that it is not a monolith
and is very easy to interface with external tools. So, I was able to
write up Guix system configuration to do it. But, if Cuirass can provide
smoother integration with Guix, I'm more than happy to switch. The main
blocker is the postgres database.

Regards,
Arun

Re: Arun Isaac Presentation on guix-forge this Saturday

[Olivier Dion via Development of GNU Guix and the GNU System distribution.]

On Thu, 26 May 2022, Arun Isaac <arunisaac@systemreboot.net> wrote:
>> Tell me, does Laminar check for channels update like cuirass?  The main
>> feature I like about cuirass is that if any dependencies of a package is
>> updated, it will rebuild my package.  If it does support that, I will
>> seriously consider switching to guix-forge for my project.

> it should be possible to set up something that runs `laminarc queue
> <job-name>' on dependency changes.

Right.  It's just a matter of checking how cuirass does it and do the
same in guix-forge.

> Laminar stands out from other CI systems in that it is not a monolith
> and is very easy to interface with external tools. So, I was able to
> write up Guix system configuration to do it. But, if Cuirass can provide
> smoother integration with Guix, I'm more than happy to switch. The main
> blocker is the postgres database.

Right.  Postgresql makes sens for huge CI like ci.guix.gnu.org I guess.
However it would indeed be nice to have the option to select sqlite as
the DBMS.  For the Guile portion that should be trivial I think.  The
difficult part is probably within the SQL schema, if Postgresql'
extensions were used.  Maybe the solution would be to use a
object-relational mapper and generate the schemas on the fly depending
on the DBMS.  I think that `guile-dbi` does just that.

To continue :-)

Regards,
old

-- 
Olivier Dion
oldiob.dev

Re: Arun Isaac Presentation on guix-forge this Saturday

[Arun Isaac]

Hi Olivier,

> Right.  Postgresql makes sens for huge CI like ci.guix.gnu.org I guess.
> However it would indeed be nice to have the option to select sqlite as
> the DBMS.

Exactly!

> Maybe the solution would be to use a object-relational mapper and
> generate the schemas on the fly depending on the DBMS.  I think that
> `guile-dbi` does just that.

I think object-relational mappers add too much complexity. guile-dbi and
guile-dbd-* with simple SQL queries should be more than sufficient for
the job.

Regards,
Arun

Cuirass and SQL

[zimoun]

Hi,

On jeu., 26 mai 2022 at 00:24, Arun Isaac <arunisaac@systemreboot.net> wrote:

>> Quick question about guix-forge.  Why laminar instead of cuirass as
>> the CI?
>
> Two reasons:
>
> - Cuirass requires a PostgreSQL database, but I wanted guix-forge to be
>   as stateless as possible and definitely not require a complex database
>   server like PostgreSQL. Laminar just uses sqlite.

Initially, Cuirass was using SQLite but then switched [1] to
PostgreSQL.  The main reason is scalability.

I do not know if it is a technically doable to have two SQL backends and
let the user pick the one they prefer.  For sure, it is not doable from
a maintenance point of view.

About the complexity of PostgreSQL, I think the Guix services [2,3] help here.



1: <http://git.savannah.gnu.org/cgit/guix/guix-cuirass.git/commit/?id=cbc462679d2647ecc897231cc78781a90fa2441a>
2: <https://guix.gnu.org/en/manual/devel/en/guix.html#Continuous-Integration>
3: <https://guix.gnu.org/en/manual/devel/en/guix.html#Database-Services>


Cheers,
simon

Re: Cuirass and SQL

[Blake Shaw]

[-- Attachment #1: Type: text/plain, Size: 1910 bytes --]

For any cuirass-curious readers, I want to say I deployed it on Linode a
week ago and its been one of the most "just works" out-of-the-box tools in
the guix arsenal that I've encountered. It was really easy and painless to
get going, and makes "pinning" milestone system & profile generations a
breeze so that you always have substitutes available for them. This has
sped up my guix workflow tremendously, as I'm able to just commit push,
branch off, try other ideas, push, review past results and keep moving,
instead of getting distracted by checking the news or what have you.

 The remote-server sometimes stops allocating builds to workers though, but
I just restart the server and its fine.

Feels like proper boutique gear, too ;)

On Fri, May 27, 2022, 16:41 zimoun <zimon.toutoune@gmail.com> wrote:

> Hi,
>
> On jeu., 26 mai 2022 at 00:24, Arun Isaac <arunisaac@systemreboot.net>
> wrote:
>
> >> Quick question about guix-forge.  Why laminar instead of cuirass as
> >> the CI?
> >
> > Two reasons:
> >
> > - Cuirass requires a PostgreSQL database, but I wanted guix-forge to be
> >   as stateless as possible and definitely not require a complex database
> >   server like PostgreSQL. Laminar just uses sqlite.
>
> Initially, Cuirass was using SQLite but then switched [1] to
> PostgreSQL.  The main reason is scalability.
>
> I do not know if it is a technically doable to have two SQL backends and
> let the user pick the one they prefer.  For sure, it is not doable from
> a maintenance point of view.
>
> About the complexity of PostgreSQL, I think the Guix services [2,3] help
> here.
>
>
>
> 1: <
> http://git.savannah.gnu.org/cgit/guix/guix-cuirass.git/commit/?id=cbc462679d2647ecc897231cc78781a90fa2441a
> >
> 2: <
> https://guix.gnu.org/en/manual/devel/en/guix.html#Continuous-Integration>
> 3: <https://guix.gnu.org/en/manual/devel/en/guix.html#Database-Services>
>
>
> Cheers,
> simon
>
>

[-- Attachment #2: Type: text/html, Size: 2983 bytes --]

Re: Cuirass and SQL

[Arun Isaac]

Hi zimoun,

> Initially, Cuirass was using SQLite but then switched [1] to
> PostgreSQL.  The main reason is scalability.

Ah, I see. I didn't know that.

> I do not know if it is a technically doable to have two SQL backends and
> let the user pick the one they prefer.  For sure, it is not doable from
> a maintenance point of view.

It should be possible with guile-dbi and guile-dbd-*, which abstract
away the database server in use. But, cuirass switched from
guile-sqlite3 to guile-squee, both of which are database server
specific.

> About the complexity of PostgreSQL, I think the Guix services [2,3]
> help here.

There's still the complexity of backing up a PostgreSQL
database---something IIUC the Guix service does not help with, and
probably cannot help with. Then, there's the added complexity of
maintaining database users and authentication. All this is very overkill
for a small CI system.

Cheers!
Arun

Re: Cuirass and SQL

[Ryan Prior]

------- Original Message -------
On Saturday, May 28th, 2022 at 8:45 AM, Arun Isaac <arunisaac@systemreboot.net> wrote:

> There's still the complexity of backing up a PostgreSQL
> database

How much easier is sqlite3?

I host a Postgres server on DigitalOcean with automatic db backup. I've had to restore, it's easy and it works. I also have a few apps in Fly.io using sqlite3, backups are equivalently easy.

> Then, there's the added complexity of
> maintaining database users and authentication

For simplicity in a single-system deployment I recommend running postgres in "trust" mode and listen on a local unix socket rather than exposing it to the network. This allows you to use the same access control for Postgres that you'd use for an sqlite3 db file: file permissions.

Re: Cuirass and SQL

[Arun Isaac]

> For simplicity in a single-system deployment I recommend running
> postgres in "trust" mode and listen on a local unix socket rather than
> exposing it to the network. This allows you to use the same access
> control for Postgres that you'd use for an sqlite3 db file: file
> permissions.

This is useful, thanks! I didn't know about this.

Re: Cuirass and SQL

[Ludovic Courtès]

Hi,

Arun Isaac <arunisaac@systemreboot.net> skribis:

>> Initially, Cuirass was using SQLite but then switched [1] to
>> PostgreSQL.  The main reason is scalability.
>
> Ah, I see. I didn't know that.

Years before, Hydra (https://nixos.org/hydra) also dropped its SQLite
backend in favor of PostgreSQL only.

Like you, not being a database person, I liked that SQLite was easy to
deploy and had a clear model: it just touches this one file and that’s it.

Yet, I’m starting to see a pattern.  :-)

SQLite may be good enough at a small scale; the problem is that you
never know how long it’ll be before the project you’re hosting is no
longer small-scale.

Ludo’.

Re: Cuirass and SQL

[Arun Isaac]

Hi Ludo,

> Years before, Hydra (https://nixos.org/hydra) also dropped its SQLite
> backend in favor of PostgreSQL only.
>
> Like you, not being a database person, I liked that SQLite was easy to
> deploy and had a clear model: it just touches this one file and that’s
> it.

Exactly! :-)

If we use guile-dbi, it should be possible to support both sqlite and
postgresql. Popular projects like Nextcloud do allow the user to choose
their preferred database system. But, then again, Cuirass is built for
very large scale. So, perhaps it is best to not try and also cover the
small scale end.

> SQLite may be good enough at a small scale; the problem is that you
> never know how long it’ll be before the project you’re hosting is no
> longer small-scale.

Scale may not be an issue at least for the CI. Unlike Guix which needs
to rebuild the entire world of software, most other software are only
going to have a handful of jobs---easily less than 5 or less than 10 in
the worst case. So, even if we trigger all these jobs on every commit,
the total number of runs will easily be manageable with sqlite.

Regards,
Arun

Re: Cuirass and SQL

[Ludovic Courtès]

Hi,

Arun Isaac <arunisaac@systemreboot.net> skribis:

>> Years before, Hydra (https://nixos.org/hydra) also dropped its SQLite
>> backend in favor of PostgreSQL only.
>>
>> Like you, not being a database person, I liked that SQLite was easy to
>> deploy and had a clear model: it just touches this one file and that’s
>> it.
>
> Exactly! :-)
>
> If we use guile-dbi, it should be possible to support both sqlite and
> postgresql. Popular projects like Nextcloud do allow the user to choose
> their preferred database system. But, then again, Cuirass is built for
> very large scale. So, perhaps it is best to not try and also cover the
> small scale end.

That too was my understanding some years ago.  :-)

But then I discovered that in practice, you optimize for a specific
DBMS.  The way you’d optimize a Postgres or an SQLite database for your
application can be quite different.  An abstraction wouldn’t let you do
that.

> Scale may not be an issue at least for the CI. Unlike Guix which needs
> to rebuild the entire world of software, most other software are only
> going to have a handful of jobs---easily less than 5 or less than 10 in
> the worst case. So, even if we trigger all these jobs on every commit,
> the total number of runs will easily be manageable with sqlite.

Yes, could be!

Thanks,
Ludo’.

Re: Cuirass and SQL

[jgart]

On Fri, 27 May 2022 11:06:24 +0200 zimoun <zimon.toutoune@gmail.com> wrote:

Hi Guixers,

Here is the video recording from today:

https://archive.org/details/guix-forge-arun-isaac-may-28-2022

enjoy,

jgart

https://whereis.xn--q9jyb4c/

Re: Cuirass and SQL

[Olivier Dion via Development of GNU Guix and the GNU System distribution.]

On Fri, 27 May 2022, zimoun <zimon.toutoune@gmail.com> wrote:

> Initially, Cuirass was using SQLite but then switched [1] to
> PostgreSQL.  The main reason is scalability.

Make sens for the main CI used by Guix or for an organization.

> I do not know if it is a technically doable to have two SQL backends and
> let the user pick the one they prefer.  For sure, it is not doable from
> a maintenance point of view.

With guile-dbi, the maintenance is trivial.

> About the complexity of PostgreSQL, I think the Guix services [2,3]
> help here.

This is what I did.  I have a local CI as a service that build my
projects at every new commits on a specific branch.  It works, but I
feel thing would have been easier to setup with SQLite.  It could had
been a guix-home service for example instead of a system service and
testing the configuration is much easier with a scratch DB.

-- 
Olivier Dion
oldiob.dev

Re: Arun Isaac Presentation on guix-forge this Saturday

[david larsson]

On 2022-05-25 16:14, Olivier Dion via "Development of GNU Guix and the 
GNU System distribution." wrote:
> On Tue, 24 May 2022, jgart <jgart@dismail.de> wrote:
>> hi guixers!
>> 
>> I'd like to invite you this Saturday to a presentation on guix-forge 
>> by Arun Isaac:
>> 
>> https://guix-forge.systemreboot.net/
> 
> Quick question about guix-forge.  Why laminar instead of cuirass as the 
> CI?

If you want to use cuirass to build certain packages on new commits to 
those packages (or specific branches thereof), I wrote a script that 
does that about a year ago, it might be of interest:

https://gitlab.com/methuselah-0/guix-cigmon

Though no fancy interface comes included :)

Best regards,
David