* [bug#67722] [PATCH] gnu: libtorrent-rasterbar: Remove timeout for tests.
@ 2023-12-09 0:31 Tomas Volf
2023-12-09 19:34 ` [bug#67722] [PATCH v2] " Tomas Volf
` (2 more replies)
0 siblings, 3 replies; 7+ messages in thread
From: Tomas Volf @ 2023-12-09 0:31 UTC (permalink / raw)
To: 67722; +Cc: Tomas Volf
The timeout is still enforced by the build farm for the build as a whole, so
it should not cause any builds to be permanently stuck.
* gnu/packages/bittorrent.scm
(libtorrent-rasterbar)[arguments]<#:phases>['check]: Remote test timeout.
Change-Id: I535c72fec24658a4b2151d2e8794319055c9a278
---
gnu/packages/bittorrent.scm | 17 +++++------------
1 file changed, 5 insertions(+), 12 deletions(-)
diff --git a/gnu/packages/bittorrent.scm b/gnu/packages/bittorrent.scm
index 8c032940d4..5d7d05178b 100644
--- a/gnu/packages/bittorrent.scm
+++ b/gnu/packages/bittorrent.scm
@@ -470,7 +470,6 @@ (define-public libtorrent-rasterbar
(exclude-regex (string-append "^("
(string-join disabled-tests "|")
")$"))
- (timeout "600")
(jobs (if parallel-tests?
(number->string (parallel-job-count))
"1")))
@@ -478,7 +477,6 @@ (define-public libtorrent-rasterbar
(invoke "ctest"
"-E" exclude-regex
"-j" jobs
- "--timeout" timeout
"--output-on-failure")
;; test_ssl relies on bundled TLS certificates with a fixed
;; expiry date. To ensure succesful builds in the future,
@@ -488,16 +486,11 @@ (define-public libtorrent-rasterbar
;; test_fast_extension, test_privacy and test_resolve_links
;; to hang, even with FAKETIME_ONLY_CMDS. Not sure why. So
;; execute only test_ssl under faketime.
- ;;
- ;; Note: The test_ssl test times out in the ci.
- ;; Temporarily disable it until that is resolved.
- ;; (invoke "faketime" "2022-10-24"
- ;; "ctest"
- ;; "-R" "^test_ssl$"
- ;; "-j" jobs
- ;; "--timeout" timeout
- ;; "--output-on-failure")
- )))))))
+ (invoke "faketime" "2022-10-24"
+ "ctest"
+ "-R" "^test_ssl$"
+ "-j" jobs
+ "--output-on-failure"))))))))
(inputs (list boost openssl))
(native-inputs `(("libfaketime" ,libfaketime)
("python-wrapper" ,python-wrapper)
base-commit: 5e4c31518aba62b2cca7c346bcc56cfa9a4d10d0
--
2.41.0
^ permalink raw reply related [flat|nested] 7+ messages in thread* [bug#67722] [PATCH v2] gnu: libtorrent-rasterbar: Remove timeout for tests.
2023-12-09 0:31 [bug#67722] [PATCH] gnu: libtorrent-rasterbar: Remove timeout for tests Tomas Volf
@ 2023-12-09 19:34 ` Tomas Volf
2023-12-12 8:11 ` Ludovic Courtès
2023-12-13 16:38 ` [bug#67722] [PATCH v3] gnu: libtorrent-rasterbar: Work around hang in test_ssl Tomas Volf
2023-12-15 11:32 ` [bug#67722] [PATCH v4] " Tomas Volf
2 siblings, 1 reply; 7+ messages in thread
From: Tomas Volf @ 2023-12-09 19:34 UTC (permalink / raw)
To: 67722; +Cc: Tomas Volf
The timeout is still enforced by the build farm for the build as a whole, so
it should not cause any builds to be permanently stuck.
* gnu/packages/bittorrent.scm
(libtorrent-rasterbar)[arguments]<#:phases>['check]: Remote test timeout.
Change-Id: I535c72fec24658a4b2151d2e8794319055c9a278
---
gnu/packages/bittorrent.scm | 3 ---
1 file changed, 3 deletions(-)
diff --git a/gnu/packages/bittorrent.scm b/gnu/packages/bittorrent.scm
index 731c8e1c20..5d7d05178b 100644
--- a/gnu/packages/bittorrent.scm
+++ b/gnu/packages/bittorrent.scm
@@ -470,7 +470,6 @@ (define-public libtorrent-rasterbar
(exclude-regex (string-append "^("
(string-join disabled-tests "|")
")$"))
- (timeout "600")
(jobs (if parallel-tests?
(number->string (parallel-job-count))
"1")))
@@ -478,7 +477,6 @@ (define-public libtorrent-rasterbar
(invoke "ctest"
"-E" exclude-regex
"-j" jobs
- "--timeout" timeout
"--output-on-failure")
;; test_ssl relies on bundled TLS certificates with a fixed
;; expiry date. To ensure succesful builds in the future,
@@ -492,7 +490,6 @@ (define-public libtorrent-rasterbar
"ctest"
"-R" "^test_ssl$"
"-j" jobs
- "--timeout" timeout
"--output-on-failure"))))))))
(inputs (list boost openssl))
(native-inputs `(("libfaketime" ,libfaketime)
base-commit: 61f2d84e75c340c2ba528d392f522c51b8843f34
--
2.41.0
^ permalink raw reply related [flat|nested] 7+ messages in thread* [bug#67722] [PATCH v2] gnu: libtorrent-rasterbar: Remove timeout for tests.
2023-12-09 19:34 ` [bug#67722] [PATCH v2] " Tomas Volf
@ 2023-12-12 8:11 ` Ludovic Courtès
2023-12-12 23:03 ` Tomas Volf
0 siblings, 1 reply; 7+ messages in thread
From: Ludovic Courtès @ 2023-12-12 8:11 UTC (permalink / raw)
To: Tomas Volf; +Cc: 67722
Hello,
Tomas Volf <~@wolfsden.cz> skribis:
> The timeout is still enforced by the build farm for the build as a whole, so
> it should not cause any builds to be permanently stuck.
>
> * gnu/packages/bittorrent.scm
> (libtorrent-rasterbar)[arguments]<#:phases>['check]: Remote test timeout.
>
> Change-Id: I535c72fec24658a4b2151d2e8794319055c9a278
[...]
> - (timeout "600")
> (jobs (if parallel-tests?
> (number->string (parallel-job-count))
> "1")))
> @@ -478,7 +477,6 @@ (define-public libtorrent-rasterbar
> (invoke "ctest"
> "-E" exclude-regex
> "-j" jobs
> - "--timeout" timeout
What’s the rationale though?
If we know that tests, individually, are meant to take less than 10mn,
it still seems nicer to stop at 10mn rather than wait for the 1h
max-silent timeout, no?
Thanks,
Ludo’.
^ permalink raw reply [flat|nested] 7+ messages in thread
* [bug#67722] [PATCH v2] gnu: libtorrent-rasterbar: Remove timeout for tests.
2023-12-12 8:11 ` Ludovic Courtès
@ 2023-12-12 23:03 ` Tomas Volf
0 siblings, 0 replies; 7+ messages in thread
From: Tomas Volf @ 2023-12-12 23:03 UTC (permalink / raw)
To: Ludovic Courtès; +Cc: 67722
[-- Attachment #1: Type: text/plain, Size: 1737 bytes --]
On 2023-12-12 09:11:07 +0100, Ludovic Courtès wrote:
> What’s the rationale though?
>
> If we know that tests, individually, are meant to take less than 10mn,
> it still seems nicer to stop at 10mn rather than wait for the 1h
> max-silent timeout, no?
Originally the rationale was to just try it out and see if it works in the CI or
not. The timeout was not originally there, I added it during fixing of the
tests so I wondered if it was a mistake. Since the QA is still in "Pending",
jury is still out on that one.
I do not know enough about the architecture and utilization of the build
machines to be sure, so one of my hypotheses was that the machine might have
been overloaded during the test run causing the timeout. So I wanted to test
it. (I sent this as #67693 at first, but I think the CI got confused by the WIP
prefix. I am not sure what is a way to mark patches intended to check the CI,
but not necessarily intended to be merged. Sorry you wasted the time reviewing
this, I did not expect anyone to look until the CI passes.)
In the mean time I was running the build locally to see if I can reproduce the
hang and I can. After running for couple of hours in a loop the build failed
with the timeout (not sure on what round, guix build --rounds does not tell
that).
So it seems like the test_ssl is just prone to sporadic failures. Since we both
succeeded in building locally, I assume we just got unlucky (or lucky?) in the
CI.
I am currently testing a v3, and once it passes --rounds=64 (which will take a
while) I will sent it as an updated patch.
Tomas
--
There are only two hard things in Computer Science:
cache invalidation, naming things and off-by-one errors.
[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 833 bytes --]
^ permalink raw reply [flat|nested] 7+ messages in thread
* [bug#67722] [PATCH v3] gnu: libtorrent-rasterbar: Work around hang in test_ssl.
2023-12-09 0:31 [bug#67722] [PATCH] gnu: libtorrent-rasterbar: Remove timeout for tests Tomas Volf
2023-12-09 19:34 ` [bug#67722] [PATCH v2] " Tomas Volf
@ 2023-12-13 16:38 ` Tomas Volf
2023-12-15 11:32 ` [bug#67722] [PATCH v4] " Tomas Volf
2 siblings, 0 replies; 7+ messages in thread
From: Tomas Volf @ 2023-12-13 16:38 UTC (permalink / raw)
To: 67722; +Cc: Tomas Volf
test_ssl does sometimes hang (at least when executed under faketime). It is
somewhat unlikely to happen, and (on my machine) required a build with
--rounds=32 to reproduce it.
The workaround is to set somewhat lower timeout of 240s (expected test
duration * 5 rounded up to whole minutes) and retry few times on failure. In
this way, --rounds=64 finished successfully (on my machine).
At the same time remove the timeout from the other tests, since it is not
necessary (they do not hang), and one of them runs for ~270s (almost half the
original timeout), so it could posse a problem on slow/overloaded machine.
* gnu/packages/bittorrent.scm
(libtorrent-rasterbar)[arguments]<#:phases>['check]: Remote test timeout for
most tests. Lower the timeout for test_ssl. Retry test_ssl on failure.
Change-Id: I535c72fec24658a4b2151d2e8794319055c9a278
---
gnu/packages/bittorrent.scm | 8 +++++---
1 file changed, 5 insertions(+), 3 deletions(-)
diff --git a/gnu/packages/bittorrent.scm b/gnu/packages/bittorrent.scm
index 731c8e1c20..4585c3b088 100644
--- a/gnu/packages/bittorrent.scm
+++ b/gnu/packages/bittorrent.scm
@@ -470,7 +470,6 @@ (define-public libtorrent-rasterbar
(exclude-regex (string-append "^("
(string-join disabled-tests "|")
")$"))
- (timeout "600")
(jobs (if parallel-tests?
(number->string (parallel-job-count))
"1")))
@@ -478,7 +477,6 @@ (define-public libtorrent-rasterbar
(invoke "ctest"
"-E" exclude-regex
"-j" jobs
- "--timeout" timeout
"--output-on-failure")
;; test_ssl relies on bundled TLS certificates with a fixed
;; expiry date. To ensure succesful builds in the future,
@@ -492,7 +490,11 @@ (define-public libtorrent-rasterbar
"ctest"
"-R" "^test_ssl$"
"-j" jobs
- "--timeout" timeout
+ ;; test_ssl sometimes hangs (at least when run under
+ ;; faketime), therefore set a time limit and retry
+ ;; few times on failure.
+ "--timeout" "240"
+ "--repeat" "until-pass:5"
"--output-on-failure"))))))))
(inputs (list boost openssl))
(native-inputs `(("libfaketime" ,libfaketime)
base-commit: 1b2505217cf222d98cc960b8510660976a01cfa1
--
2.41.0
^ permalink raw reply related [flat|nested] 7+ messages in thread* [bug#67722] [PATCH v4] gnu: libtorrent-rasterbar: Work around hang in test_ssl.
2023-12-09 0:31 [bug#67722] [PATCH] gnu: libtorrent-rasterbar: Remove timeout for tests Tomas Volf
2023-12-09 19:34 ` [bug#67722] [PATCH v2] " Tomas Volf
2023-12-13 16:38 ` [bug#67722] [PATCH v3] gnu: libtorrent-rasterbar: Work around hang in test_ssl Tomas Volf
@ 2023-12-15 11:32 ` Tomas Volf
2024-01-16 13:27 ` Tomas Volf
2 siblings, 1 reply; 7+ messages in thread
From: Tomas Volf @ 2023-12-15 11:32 UTC (permalink / raw)
To: 67722; +Cc: Tomas Volf
test_ssl does sometimes hang (at least when executed under faketime). It is
somewhat unlikely to happen, and (on my machine) required a build with
--rounds=32 to reproduce it.
The workaround is to set somewhat lower timeout of 240s (expected test
duration * 5 rounded up to whole minutes) and retry few times on failure. In
this way, --rounds=64 finished successfully (on my machine).
At the same time remove the timeout from the other tests, since it is not
necessary (they do not hang), and one of them runs for ~270s (almost half the
original timeout), so it could posse a problem on slow/overloaded machine.
* gnu/packages/bittorrent.scm
(libtorrent-rasterbar)[arguments]<#:phases>['check]: Remote test timeout for
most tests. Lower the timeout for test_ssl. Retry test_ssl on failure.
Change-Id: I535c72fec24658a4b2151d2e8794319055c9a278
---
No changes, just rebase, resolving a merge conflict.
gnu/packages/bittorrent.scm | 22 ++++++++++------------
1 file changed, 10 insertions(+), 12 deletions(-)
diff --git a/gnu/packages/bittorrent.scm b/gnu/packages/bittorrent.scm
index 8c032940d4..4585c3b088 100644
--- a/gnu/packages/bittorrent.scm
+++ b/gnu/packages/bittorrent.scm
@@ -470,7 +470,6 @@ (define-public libtorrent-rasterbar
(exclude-regex (string-append "^("
(string-join disabled-tests "|")
")$"))
- (timeout "600")
(jobs (if parallel-tests?
(number->string (parallel-job-count))
"1")))
@@ -478,7 +477,6 @@ (define-public libtorrent-rasterbar
(invoke "ctest"
"-E" exclude-regex
"-j" jobs
- "--timeout" timeout
"--output-on-failure")
;; test_ssl relies on bundled TLS certificates with a fixed
;; expiry date. To ensure succesful builds in the future,
@@ -488,16 +486,16 @@ (define-public libtorrent-rasterbar
;; test_fast_extension, test_privacy and test_resolve_links
;; to hang, even with FAKETIME_ONLY_CMDS. Not sure why. So
;; execute only test_ssl under faketime.
- ;;
- ;; Note: The test_ssl test times out in the ci.
- ;; Temporarily disable it until that is resolved.
- ;; (invoke "faketime" "2022-10-24"
- ;; "ctest"
- ;; "-R" "^test_ssl$"
- ;; "-j" jobs
- ;; "--timeout" timeout
- ;; "--output-on-failure")
- )))))))
+ (invoke "faketime" "2022-10-24"
+ "ctest"
+ "-R" "^test_ssl$"
+ "-j" jobs
+ ;; test_ssl sometimes hangs (at least when run under
+ ;; faketime), therefore set a time limit and retry
+ ;; few times on failure.
+ "--timeout" "240"
+ "--repeat" "until-pass:5"
+ "--output-on-failure"))))))))
(inputs (list boost openssl))
(native-inputs `(("libfaketime" ,libfaketime)
("python-wrapper" ,python-wrapper)
base-commit: b681e339fa37f2a26763458ee56b31af1d6a7ec5
--
2.41.0
^ permalink raw reply related [flat|nested] 7+ messages in thread
end of thread, other threads:[~2024-01-16 13:28 UTC | newest]
Thread overview: 7+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2023-12-09 0:31 [bug#67722] [PATCH] gnu: libtorrent-rasterbar: Remove timeout for tests Tomas Volf
2023-12-09 19:34 ` [bug#67722] [PATCH v2] " Tomas Volf
2023-12-12 8:11 ` Ludovic Courtès
2023-12-12 23:03 ` Tomas Volf
2023-12-13 16:38 ` [bug#67722] [PATCH v3] gnu: libtorrent-rasterbar: Work around hang in test_ssl Tomas Volf
2023-12-15 11:32 ` [bug#67722] [PATCH v4] " Tomas Volf
2024-01-16 13:27 ` Tomas Volf
Code repositories for project(s) associated with this public inbox
https://git.savannah.gnu.org/cgit/guix.git
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).