Guix Data Service can now poll for new revisions/branches

Guix Data Service can now poll for new revisions/branches

[Christopher Baines]

[-- Attachment #1: Type: text/plain, Size: 755 bytes --]

Hey,

As has happened before in the past, at the moment we're not getting
emails to guix-commits for the main guix.git repository. This impacts
the data service instances as they use these emails to know when there
are new revisions to process.

I've now added the ability to configure the data service to poll the
repository for changes and I've enabled this on both data.guix.gnu.org
and data.qa.guix.gnu.org, which should mean they'll be shortly back up
to date.

This sounds easy, but it was a little tricky to implement, as I didn't
want to remove the email feature in favour of polling, at least not
yet. It's also had a large impact on data.qa.guix.gnu.org, as now it's
learned about lots of older branches that it didn't know about before.

Chris

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 987 bytes --]

Re: Guix Data Service can now poll for new revisions/branches

[Maxim Cournoyer]

Hi Christopher,

Christopher Baines <mail@cbaines.net> writes:

> Hey,
>
> As has happened before in the past, at the moment we're not getting
> emails to guix-commits for the main guix.git repository. This impacts
> the data service instances as they use these emails to know when there
> are new revisions to process.
>
> I've now added the ability to configure the data service to poll the
> repository for changes and I've enabled this on both data.guix.gnu.org
> and data.qa.guix.gnu.org, which should mean they'll be shortly back up
> to date.
>
> This sounds easy, but it was a little tricky to implement, as I didn't
> want to remove the email feature in favour of polling, at least not
> yet. It's also had a large impact on data.qa.guix.gnu.org, as now it's
> learned about lots of older branches that it didn't know about before.

Ludovic recently implemented a mechanism to notify Cuirass of new
commits via the Savannah server-side git hook; perhaps you could use
that as well?  It should be cheaper than polling on the git repo.

-- 
Thanks,
Maxim

Re: Guix Data Service can now poll for new revisions/branches

[Christopher Baines]

[-- Attachment #1: Type: text/plain, Size: 1337 bytes --]


Maxim Cournoyer <maxim.cournoyer@gmail.com> writes:

> Hi Christopher,
>
> Christopher Baines <mail@cbaines.net> writes:
>
>> Hey,
>>
>> As has happened before in the past, at the moment we're not getting
>> emails to guix-commits for the main guix.git repository. This impacts
>> the data service instances as they use these emails to know when there
>> are new revisions to process.
>>
>> I've now added the ability to configure the data service to poll the
>> repository for changes and I've enabled this on both data.guix.gnu.org
>> and data.qa.guix.gnu.org, which should mean they'll be shortly back up
>> to date.
>>
>> This sounds easy, but it was a little tricky to implement, as I didn't
>> want to remove the email feature in favour of polling, at least not
>> yet. It's also had a large impact on data.qa.guix.gnu.org, as now it's
>> learned about lots of older branches that it didn't know about before.
>
> Ludovic recently implemented a mechanism to notify Cuirass of new
> commits via the Savannah server-side git hook; perhaps you could use
> that as well?  It should be cheaper than polling on the git repo.

Yeah, there's also this UDP thing that Giovanni mentioned:

  https://lists.gnu.org/archive/html/guix-devel/2023-09/msg00153.html

Both approaches should be easier to implement now that polling is
implemented.

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 987 bytes --]