* bug#44390: Cuirass reports succesful builds as failed in /var/log/cuirass.log and cuirass-web reports them as scheduled
@ 2020-11-02 15:04 david larsson
2020-11-02 16:28 ` Mathieu Othacehe
` (2 more replies)
0 siblings, 3 replies; 7+ messages in thread
From: david larsson @ 2020-11-02 15:04 UTC (permalink / raw)
To: 44390
Hi!
In /var/log/cuirass.log:
2020-11-02T15:41:34 build succeeded:
'/gnu/store/aqn31rymjs3qybsd1d2ssn93f8s0jlz5-git-checkout.drv'
2020-11-02T15:41:35 build started:
'/gnu/store/q7q6s24h05kxib5wvjmnn5zmy6vh3m63-git-checkout.drv'
2020-11-02T15:41:39 build succeeded:
'/gnu/store/q7q6s24h05kxib5wvjmnn5zmy6vh3m63-git-checkout.drv'
2020-11-02T15:41:39 build started:
'/gnu/store/hwkdx9qabrp8q3anc1d0brnxfr7xdj2n-orgmk-v0.0.2.drv'
2020-11-02T15:41:40 build succeeded:
'/gnu/store/hwkdx9qabrp8q3anc1d0brnxfr7xdj2n-orgmk-v0.0.2.drv'
2020-11-02T15:41:41 build started:
'/gnu/store/2lxjrb5sfi0mxj1871zb5g47nkg76j6z-fwknop-3.0.0.drv'
2020-11-02T15:42:19 build succeeded:
'/gnu/store/2lxjrb5sfi0mxj1871zb5g47nkg76j6z-fwknop-3.0.0.drv'
2020-11-02T15:42:20 done with 10 derivations
2020-11-02T15:42:20 outputs:
/gnu/store/a462kby1q51ndvxdv3b6p0rsixxrgx1h-hello-2.10
/gnu/store/p02qaingwm7hmlax4zh9af8d72jivdnr-cowsay-3.04
/gnu/store/bj30r24xjv55nh1lx0r24psrlrm5haif-orgmk-v0.0.2
/gnu/store/nbknii5yq7djc6vg90kay7jiplk65n2i-fwknop-3.0.0
/gnu/store/bprgycch5x2bh8gch32nksw9cvrii2lc-python-on-guile-1.2.3.5
/gnu/store/97aggnqbar8gzwfqqxf8mk10rpia9244-libxml2-xpath0-1.1.1-0.0.0.6c7a378
/gnu/store/9bszaplxdxg3l6wid9l7lf6vqnnmkyic-libxml2-xpath0-1.1.1-0.0.0.6c7a378-static
/gnu/store/8nw4nz1l72yxalni2xnfdna2qpxr87r8-guile-bash-parallel-v0.0.7
/gnu/store/cqdqaa0nsvjqv7003sfkfiv9b8r2080k-guile-base64-v0.0.1
/gnu/store/1sq6cnpnpzpxmv9nkpfvim9wild6c303-perl-data-ical-0.24
/gnu/store/4ijsrmkb02z2s18bgkw5kyvf4kpwsdyg-python-pydotplus-2.0.2
2020-11-02T15:42:20 success: 0, fail: 10
2020-11-02T15:42:34 heap: 44.49 MiB; threads: 11; file descriptors: 4
And in the web interface they are reported as "Scheduled":
Input Commit
git://git.savannah.gnu.org/guix.git 28e20c53530671ece8421ccb4ac815fd1beaf9fe
file:///home/cuirass/my-guix-packages 9f9c644076b088aabee76626598115c0fe6bfbde
Pending builds of evaluation #1
All 10
Scheduled 10
Succeeded 0
Failed 0
ID Specification Completion time Job Name System Log
10 my-pkgs — python-pydotplus-2.0.2.x86_64-linux python-pydotplus-2.0.2 x86_64-linux —
9 my-pkgs — perl-data-ical-0.24.x86_64-linux perl-data-ical-0.24 x86_64-linux —
8 my-pkgs — guile-base64-v0.0.1.x86_64-linux guile-base64-v0.0.1 x86_64-linux —
7 my-pkgs — guile-bash-parallel-v0.0.7.x86_64-linux guile-bash-parallel-v0.0.7 x86_64-linux —
6 my-pkgs — libxml2-xpath0-1.1.1-0.0.0.6c7a378.x86_64-linux libxml2-xpath0-1.1.1-0.0.0.6c7a378 x86_64-linux —
5 my-pkgs — python-on-guile-1.2.3.5.x86_64-linux python-on-guile-1.2.3.5 x86_64-linux —
4 my-pkgs — fwknop-3.0.0.x86_64-linux fwknop-3.0.0 x86_64-linux —
3 my-pkgs — orgmk-v0.0.2.x86_64-linux orgmk-v0.0.2 x86_64-linux —
2 my-pkgs — cowsay-3.04.x86_64-linux cowsay-3.04 x86_64-linux —
1 my-pkgs — hello-2.10.x86_64-linux hello-2.10 x86_64-linux —
Cuirass config:
(define %cuirass-specs
#~(
;; spec two
list
'((#:name . "my-pkgs")
(#:load-path-inputs . ("guix"))
;;(#:package-path-inputs . ("my-guixsd-config.sh"))
(#:package-path-inputs . ("my-guix-packages"))
;;(#:package-path-inputs . ())
;;(#:package-path-inputs . ())
(#:proc-input . "guix")
(#:proc-file . "build-aux/cuirass/gnu-system.scm")
(#:proc . cuirass-jobs)
(#:proc-args .
(;;(subset . manifests)
;;(subset . ("hello" "cowsay" "perl-moose" "jupyter"
"enlightenment"))
(subset . ("hello" "cowsay" "orgmk" "fwknop" "python-on-guile"
"libxml2-xpath0" "guile-bash-parallel" "guile-base64" "perl-data-ical"
"python-pydotplus"))
(systems . ("x86_64-linux"))
;;(manifests . (("my-guix-packages" . "manifest.scm")))
))
(#:inputs . (
((#:name . "guix")
(#:url . "git://git.savannah.gnu.org/guix.git")
(#:load-path . ".")
(#:branch . "master")
(#:no-compile? . #t))
((#:name . "my-guix-packages")
(#:url . "file:///home/cuirass/my-guix-packages")
(#:load-path . "packages")
(#:branch . "master")
(#:no-compile? . #t))
;; ((#:name . "my-guix-packages")
;; (#:url .
"https://github.com/methuselah-0/my-guix-packages.git")
;; (#:load-path . "packages")
;; (#:branch . "master")
;; (#:no-compile? . #t))
))
(#:build-outputs . ()))
))
Best regards,
David
^ permalink raw reply [flat|nested] 7+ messages in thread
* bug#44390: Cuirass reports succesful builds as failed in /var/log/cuirass.log and cuirass-web reports them as scheduled
2020-11-02 15:04 bug#44390: Cuirass reports succesful builds as failed in /var/log/cuirass.log and cuirass-web reports them as scheduled david larsson
@ 2020-11-02 16:28 ` Mathieu Othacehe
2020-11-02 16:40 ` Jonathan Brielmaier
2020-11-06 14:07 ` Jonathan Brielmaier
2 siblings, 0 replies; 7+ messages in thread
From: Mathieu Othacehe @ 2020-11-02 16:28 UTC (permalink / raw)
To: david larsson; +Cc: 44390
Hello David,
> /gnu/store/4ijsrmkb02z2s18bgkw5kyvf4kpwsdyg-python-pydotplus-2.0.2
> 2020-11-02T15:42:20 success: 0, fail: 10
> 2020-11-02T15:42:34 heap: 44.49 MiB; threads: 11; file descriptors: 4
Thanks for the bug report. This bug is the result of some recent
optimizations. The database requests updating the build statuses are
queued and issues by batches of 100 requests.
As you only have 10 builds, those requests are only queued. That's why
the web interface reports them as "scheduled" while the log shows that
they were built.
The "fail: 10" is also a consequence of that problem. Forcing the
pending queries once a batch of builds is done could possibly solve this
problem but I need to think more about it.
Thanks,
Mathieu
^ permalink raw reply [flat|nested] 7+ messages in thread
* bug#44390: Cuirass reports succesful builds as failed in /var/log/cuirass.log and cuirass-web reports them as scheduled
2020-11-02 15:04 bug#44390: Cuirass reports succesful builds as failed in /var/log/cuirass.log and cuirass-web reports them as scheduled david larsson
2020-11-02 16:28 ` Mathieu Othacehe
@ 2020-11-02 16:40 ` Jonathan Brielmaier
2020-11-06 14:07 ` Jonathan Brielmaier
2 siblings, 0 replies; 7+ messages in thread
From: Jonathan Brielmaier @ 2020-11-02 16:40 UTC (permalink / raw)
To: 44390
Nice bug report David! I encounter the same problem :P
@Mathieu: Would it be an option to just make it configurable? It seems
that it makes a significant performance impact on larger cuirass
servers. But small servers still could set it to 1 or so...
^ permalink raw reply [flat|nested] 7+ messages in thread
* bug#44390: Cuirass reports succesful builds as failed in /var/log/cuirass.log and cuirass-web reports them as scheduled
2020-11-02 15:04 bug#44390: Cuirass reports succesful builds as failed in /var/log/cuirass.log and cuirass-web reports them as scheduled david larsson
2020-11-02 16:28 ` Mathieu Othacehe
2020-11-02 16:40 ` Jonathan Brielmaier
@ 2020-11-06 14:07 ` Jonathan Brielmaier
2020-12-06 9:16 ` david larsson
2 siblings, 1 reply; 7+ messages in thread
From: Jonathan Brielmaier @ 2020-11-06 14:07 UTC (permalink / raw)
To: 44390
In the mean time I did a quick fix on my system in config.scm:
```
(use-modules (gnu)
(gnu packages ci) (guix packages) (guix utils))
(define-public cuirass/queue-1
(package/inherit cuirass
(name "cuirass-queue-1")
(arguments
(substitute-keyword-arguments (package-arguments cuirass)
((#:phases phases)
`(modify-phases ,phases
(add-after 'disable-repo-tests 'set-queue-size
(lambda _
(substitute* "src/cuirass/database.scm"
(("queue-size 100") "queue-size 1"))
#t))))))))
```
Plus (cuirass cuirass/queue-1)
in the cuirass-configuration. So no need from my side to hurry anmyore :)
^ permalink raw reply [flat|nested] 7+ messages in thread
* bug#44390: Cuirass reports succesful builds as failed in /var/log/cuirass.log and cuirass-web reports them as scheduled
2020-11-06 14:07 ` Jonathan Brielmaier
@ 2020-12-06 9:16 ` david larsson
2020-12-08 11:09 ` Mathieu Othacehe
0 siblings, 1 reply; 7+ messages in thread
From: david larsson @ 2020-12-06 9:16 UTC (permalink / raw)
To: Jonathan Brielmaier; +Cc: bug-Guix, 44390
On 2020-11-06 15:07, Jonathan Brielmaier wrote:
> In the mean time I did a quick fix on my system in config.scm:
>
> ```
> (use-modules (gnu)
>
> (gnu packages ci) (guix packages) (guix utils))
>
>
> (define-public cuirass/queue-1
>
> (package/inherit cuirass
>
> (name "cuirass-queue-1")
>
> (arguments
>
> (substitute-keyword-arguments (package-arguments cuirass)
>
> ((#:phases phases)
>
> `(modify-phases ,phases
>
> (add-after 'disable-repo-tests 'set-queue-size
>
> (lambda _
>
> (substitute* "src/cuirass/database.scm"
>
> (("queue-size 100") "queue-size 1"))
>
> #t))))))))
>
> ```
>
> Plus (cuirass cuirass/queue-1)
> in the cuirass-configuration. So no need from my side to hurry anmyore
> :)
Thank you for this. It works well!
Best regards,
David
^ permalink raw reply [flat|nested] 7+ messages in thread
* bug#44390: Cuirass reports succesful builds as failed in /var/log/cuirass.log and cuirass-web reports them as scheduled
2020-12-06 9:16 ` david larsson
@ 2020-12-08 11:09 ` Mathieu Othacehe
2020-12-08 22:35 ` Jonathan Brielmaier
0 siblings, 1 reply; 7+ messages in thread
From: Mathieu Othacehe @ 2020-12-08 11:09 UTC (permalink / raw)
To: david larsson; +Cc: bug-Guix, Jonathan Brielmaier, 44390-done
Hello,
Cuirass commit 697fa14584551d9595cd042f1ffeba240e45a127 adds a
"--queue-size" argument.
With Guix commit 770fb659a62d8adab9a4ba7b44e2760722703879, Cuirass is
passed the "queue-size" argument, defaulting to 1.
Thanks,
Mathieu
^ permalink raw reply [flat|nested] 7+ messages in thread
* bug#44390: Cuirass reports succesful builds as failed in /var/log/cuirass.log and cuirass-web reports them as scheduled
2020-12-08 11:09 ` Mathieu Othacehe
@ 2020-12-08 22:35 ` Jonathan Brielmaier
0 siblings, 0 replies; 7+ messages in thread
From: Jonathan Brielmaier @ 2020-12-08 22:35 UTC (permalink / raw)
To: Mathieu Othacehe, david larsson; +Cc: 44390
On 08.12.20 12:09, Mathieu Othacehe wrote:
>
> Hello,
>
> Cuirass commit 697fa14584551d9595cd042f1ffeba240e45a127 adds a
> "--queue-size" argument.
>
> With Guix commit 770fb659a62d8adab9a4ba7b44e2760722703879, Cuirass is
> passed the "queue-size" argument, defaulting to 1.
Fix confirmed on my personal Cuirass server :)
Merci Mathieu!
^ permalink raw reply [flat|nested] 7+ messages in thread
end of thread, other threads:[~2020-12-08 23:00 UTC | newest]
Thread overview: 7+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2020-11-02 15:04 bug#44390: Cuirass reports succesful builds as failed in /var/log/cuirass.log and cuirass-web reports them as scheduled david larsson
2020-11-02 16:28 ` Mathieu Othacehe
2020-11-02 16:40 ` Jonathan Brielmaier
2020-11-06 14:07 ` Jonathan Brielmaier
2020-12-06 9:16 ` david larsson
2020-12-08 11:09 ` Mathieu Othacehe
2020-12-08 22:35 ` Jonathan Brielmaier
Code repositories for project(s) associated with this public inbox
https://git.savannah.gnu.org/cgit/guix.git
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).