Evaluations stuck on guix-master?

Evaluations stuck on guix-master?

[Ludovic Courtès]

Hi!

Right now evaluations at <https://ci.guix.gnu.org/jobset/guix-master>
starting 12578 to 12610 included are all marked as “In progress”.

Yet, cuirass.log has, for instance (excerpt):

  2020-04-12T22:59:24 evaluation 12578 for 'guix-master' completed
  2020-04-13T13:11:29 building 51358 jobs for 'guix-master'
  2020-04-13T15:59:40 building 51358 jobs for 'guix-master'
  2020-04-13T17:01:12 evaluation 12610 for 'guix-master' completed

and /var/log/cuirass/evaluations/12578.gz also suggests that
everything’s OK.  But cuirass.log doesn’t have the:

  evaluation XYZ registered N new derivations

message for these stuck evaluations.

These evaluations seem to all have just one matching build:

--8<---------------cut here---------------start------------->8---
sqlite> select * from builds where id= 12578;
12578|/gnu/store/w45r0jd28r8n7pq3rvvmi6anfc5qn5k0-python2-waitress-1.1.0.drv|1|python2-waitress-1.1.0.x86_64-linux|x86_64-linux|python2-waitress-1.1.0|/var/log/guix/drvs/w4/5r0jd28r8n7pq3rvvmi6anfc5qn5k0-python2-waitress-1.1.0.drv.gz|0|1532613163|0|1535574918
sqlite> select * from builds where id= 12580;
12580|/gnu/store/pgkwacsdc0vzingxs3fv7vhn0brk86k5-python2-quex-0.68.1.drv|1|python2-quex-0.68.1.x86_64-linux|x86_64-linux|python2-quex-0.68.1||4|1532613163|0|1533786490
sqlite> select * from builds where id= 12582;
12582|/gnu/store/qwjm2dj436zcq36ka2pmklf4n5r93i08-python2-apache-libcloud-2.0.0.drv|1|python2-apache-libcloud-2.0.0.x86_64-linux|x86_64-linux|python2-apache-libcloud-2.0.0||4|1532613163|0|1534172221
sqlite> select * from builds where id= 12588;
12588|/gnu/store/qgr7d40s75zpjc6zfrdpqqzknks36w3g-python-tqdm-4.19.6.drv|1|python-tqdm-4.19.6.x86_64-linux|x86_64-linux|python-tqdm-4.19.6|/var/log/guix/drvs/qg/r7d40s75zpjc6zfrdpqqzknks36w3g-python-tqdm-4.19.6.drv.gz|0|1532613163|0|1535559710
sqlite> select * from builds where id= 12610;
12610|/gnu/store/gv3pm1qb7nlxx2sshlavvir0pmm1hr8c-python-rfc3987-1.3.7.drv|1|python-rfc3987-1.3.7.x86_64-linux|x86_64-linux|python-rfc3987-1.3.7|/var/log/guix/drvs/gv/3pm1qb7nlxx2sshlavvir0pmm1hr8c-python-rfc3987-1.3.7.drv.gz|0|1532613163|0|1533090305
--8<---------------cut here---------------end--------------->8---

Yet, I don’t see stuck ‘evaluate’ processes on the machine.  So it all
looks as though registering jobs (in ‘build-packages’ in Cuirass) just
doesn’t complete.

Thoughts?

(I’ve just restarted Cuirass, let’s see how it goes.)

Ludo’.