bug#59180: [berlin] configure mumi <- debbugs sync via an rsync service

bug#59180: [berlin] configure mumi <- debbugs sync via an rsync service

[Maxim Cournoyer]

Hi,

Currently, the sync of issues with MUMI happen via a manually launched
rsync (by rekado).  We should properly configure it in the berlin.scm
configuration file, so that it sticks after a reboot.

-- 
Thanks,
Maxim

bug#59180: [berlin] configure mumi <- debbugs sync via an rsync service

[Maxim Cournoyer]

Maxim Cournoyer <maxim.cournoyer@gmail.com> writes:

> Hi,
>
> Currently, the sync of issues with MUMI happen via a manually launched
> rsync (by rekado).  We should properly configure it in the berlin.scm
> configuration file, so that it sticks after a reboot.

From Ricardo:

  We need the service to read a secret from a file, set an env var
  (RSYNC_PASSWORD), and then keep doing this:

    timeout --kill-after 5m 1h rsync --delete -av
  
-- 
Thanks,
Maxim

bug#59180: [berlin] configure mumi <- debbugs sync via an rsync service

[Felix Lechner via Bug reports for GNU Guix]

Hi Maxim,

Here is rsync service I use [1] in case that's helpful.

Kind regards
Felix

[1]
https://codeberg.org/lechner/system-config/src/commit/bf38906f52526d9d8a2bb92489b3bd51d0e7d713/host/wallace-server/operating-system.scm#L633-L651

bug#59180: [berlin] configure mumi <- debbugs sync via an rsync service

[Maxim Cournoyer]

Hi Felix,

Felix Lechner <felix.lechner@lease-up.com> writes:

> Hi Maxim,
>
> Here is rsync service I use [1] in case that's helpful.
>
> Kind regards
> Felix
>
> [1]
> https://codeberg.org/lechner/system-config/src/commit/bf38906f52526d9d8a2bb92489b3bd51d0e7d713/host/wallace-server/operating-system.scm#L633-L651

Thanks.

This is how it is manually started, peeking at top:

--8<---------------cut here---------------start------------->8---
bash -c while true; do timeout --kill-after 5m 1h rsync --delete -av debbugs-var@debbugs.gnu.org::var-lib-debbugs /var/mumi/data/; sleep 1; done
--8<---------------cut here---------------end--------------->8---

-- 
Thanks,
Maxim

bug#59180: [berlin] configure mumi <- debbugs sync via an rsync service

[Maxim Cournoyer]

Hi,

Maxim Cournoyer <maxim.cournoyer@gmail.com> writes:

> Hi Felix,
>
> Felix Lechner <felix.lechner@lease-up.com> writes:
>
>> Hi Maxim,
>>
>> Here is rsync service I use [1] in case that's helpful.
>>
>> Kind regards
>> Felix
>>
>> [1]
>> https://codeberg.org/lechner/system-config/src/commit/bf38906f52526d9d8a2bb92489b3bd51d0e7d713/host/wallace-server/operating-system.scm#L633-L651
>
> Thanks.
>
> This is how it is manually started, peeking at top:
>
> bash -c while true; do timeout --kill-after 5m 1h rsync --delete -av debbugs-var@debbugs.gnu.org::var-lib-debbugs /var/mumi/data/; sleep 1; done

I implemented the above reusing the shared mcron job almost as-is,
and it appears to work:

--8<---------------cut here---------------start------------->8---
2024-02-01 20:46:00 90211 Rsync Debbugs data: running...
2024-02-01 20:46:01 90211 Rsync Debbugs data: receiving incremental file list
2024-02-01 20:46:01 90211 Rsync Debbugs data: spool/
2024-02-01 20:46:01 90211 Rsync Debbugs data: spool/by-affects.idx
2024-02-01 20:46:01 90211 Rsync Debbugs data: spool/by-correspondent.idx
2024-02-01 20:46:02 90211 Rsync Debbugs data: spool/by-message-id.idx
2024-02-01 20:46:02 90211 Rsync Debbugs data: spool/by-owner.idx
2024-02-01 20:46:02 90211 Rsync Debbugs data: spool/by-package.idx
[...]
2024-02-01 20:46:36 90211 Rsync Debbugs data: spool/rrd/org-mode_tag.rrd
2024-02-01 20:46:36 90211 Rsync Debbugs data: spool/rrd/parted.rrd
2024-02-01 20:46:36 90211 Rsync Debbugs data: spool/rrd/parted_tag.rrd
2024-02-01 20:46:36 90211 Rsync Debbugs data: spool/rrd/sed.rrd
2024-02-01 20:46:36 90211 Rsync Debbugs data: spool/rrd/sed_tag.rrd
2024-02-01 20:46:36 90211 Rsync Debbugs data: spool/rrd/skribilo.rrd
2024-02-01 20:46:36 90211 Rsync Debbugs data: spool/rrd/skribilo_tag.rrd
2024-02-01 20:46:36 90211 Rsync Debbugs data: spool/rrd/vc-dwim.rrd
2024-02-01 20:46:36 90211 Rsync Debbugs data: spool/rrd/vc-dwim_tag.rrd
2024-02-01 20:46:36 90211 Rsync Debbugs data: spool/rrd/woodchuck.rrd
2024-02-01 20:46:36 90211 Rsync Debbugs data: spool/rrd/woodchuck_tag.rrd
2024-02-01 20:46:36 90211 Rsync Debbugs data: www/db/
2024-02-01 20:46:39 90211 Rsync Debbugs data: www/db/ix/
2024-02-01 20:46:39 90211 Rsync Debbugs data: www/db/ix/zstamp.html
2024-02-01 20:46:40 90211 Rsync Debbugs data:
2024-02-01 20:46:40 90211 Rsync Debbugs data: sent 161,909 bytes  received 8,905,931 bytes  223,897.28 bytes/sec
2024-02-01 20:46:40 90211 Rsync Debbugs data: total size is 18,780,129,589  speedup is 2,071.07
2024-02-01 20:46:40 90211 Rsync Debbugs data: completed in 40.293s
--8<---------------cut here---------------end--------------->8---

Thanks a lot, Felix!

-- 
Maxim