* bug#71942: 30.0.60; Intermittent failure in process-tests
@ 2024-07-04 19:34 john muhl
2024-07-05 7:55 ` Andrea Corallo
0 siblings, 1 reply; 3+ messages in thread
From: john muhl @ 2024-07-04 19:34 UTC (permalink / raw)
To: 71942
[-- Attachment #1: Type: text/plain, Size: 928 bytes --]
The failure is in ‘process-tests/sentinel-with-multiple-processes’
and happens on all the configurations being tested. It happens in
both ‘make check’ and running the test individually. It can be
reproduced using a script like:
#!/usr/bin/env bash
echo OK >> ~/tmp/process-tests.txt
cd ~/src/emacs
rm -f test/src/process-tests.log
make test/src/process-tests.log
and the command ‘watch -e script.sh’. For an idea how often it
fails here are the results of five runs of the above on two
different machines:
wc -l process-tests-*.txt
157 process-tests-1.txt
259 process-tests-2.txt
329 process-tests-3.txt
112 process-tests-4.txt
96 process-tests-5.txt
950 total
wc -l process-tests-*.txt
11 process-tests-1.txt
14 process-tests-2.txt
9 process-tests-3.txt
11 process-tests-4.txt
11 process-tests-5.txt
56 total
[-- Attachment #2: process-tests-1.log --]
[-- Type: text/plain, Size: 4910 bytes --]
Running 37 tests (2024-07-03 02:45:36-0500, selector `(not (or (tag :expensive-test) (tag :unstable) (tag :nativecomp)))')
passed 1/37 lookup-family-specification (0.000848 sec)
passed 2/37 lookup-google (0.012795 sec)
passed 3/37 lookup-hints-specification (0.000481 sec)
localhost/0 Name or service not known
localhost/0 Name or service not known
343.1.2.3/0 Name or service not known
343.1.2.3/0 Name or service not known
1.2.3.4.5/0 Name or service not known
1.2.3.4.5/0 Name or service not known
fe80::1/0 Address family for hostname not supported
e301::203:1/0 Address family for hostname not supported
e301:203::1/0 Address family for hostname not supported
e301:0203::1/0 Address family for hostname not supported
::1/0 Address family for hostname not supported
::0/0 Address family for hostname not supported
0343:1:2::3/0 Address family for hostname not supported
343:001:2::3/0 Address family for hostname not supported
passed 4/37 lookup-hints-values (0.000875 sec)
passed 5/37 lookup-unicode-domains (0.356801 sec)
skipped 6/37 make-process-w32-debug-spawn-error (0.000212 sec)
passed 7/37 make-process/connection-type/in-pty (0.002656 sec)
passed 8/37 make-process/connection-type/out-pty (0.002723 sec)
passed 9/37 make-process/connection-type/out-pty-with-stderr-buffer (0.002729 sec)
passed 10/37 make-process/connection-type/pipe (0.002522 sec)
passed 11/37 make-process/connection-type/pipe-2 (0.002597 sec)
passed 12/37 make-process/connection-type/pty (0.002545 sec)
passed 13/37 make-process/connection-type/pty-2 (0.002701 sec)
passed 14/37 make-process/connection-type/pty-with-stderr-buffer (0.003489 sec)
passed 15/37 make-process/file-handler/disable (0.000826 sec)
passed 16/37 make-process/file-handler/found (0.000227 sec)
passed 17/37 make-process/file-handler/not-found (0.008194 sec)
passed 18/37 make-process/mix-stderr (0.019879 sec)
passed 19/37 make-process/noquery-stderr (0.010120 sec)
passed 20/37 make-process/stop (0.000331 sec)
emacs.invalid/0 Name or service not known
passed 21/37 non-existent-lookup-failure (0.032796 sec)
passed 22/37 process-num-processors (0.000285 sec)
skipped 23/37 process-sentinel-interrupt-event (0.000287 sec)
passed 24/37 process-test-sentinel-accept-process-output (0.008299 sec)
passed 25/37 process-test-sentinel-sit-for (0.026713 sec)
passed 26/37 process-test-stderr-buffer (0.005043 sec)
passed 27/37 process-test-stderr-filter (0.005920 sec)
passed 28/37 process-tests/fd-setsize-no-crash/make-network-process (0.032965 sec)
passed 29/37 process-tests/fd-setsize-no-crash/make-pipe-process (0.026318 sec)
passed 30/37 process-tests/fd-setsize-no-crash/make-process (0.084728 sec)
passed 31/37 process-tests/fd-setsize-no-crash/make-serial-process (0.038348 sec)
passed 32/37 process-tests/multiple-threads-waiting (0.017314 sec)
passed 33/37 process-tests/sentinel-called (0.211271 sec)
Test process-tests/sentinel-with-multiple-processes backtrace:
signal(ert-test-failed (((should (equal calls (list (list process "f
ert-fail(((should (equal calls (list (list process "finished\n"))))
#f(compiled-function () #<bytecode 0x16a62428>)()
#f(compiled-function () #<bytecode 0x1b97372a>)()
handler-bind-1(#f(compiled-function () #<bytecode 0x1b97372a>) (erro
ert--run-test-internal(#s(ert--test-execution-info :test #s(ert-test
ert-run-test(#s(ert-test :name process-tests/sentinel-with-multiple-
ert-run-or-rerun-test(#s(ert--stats :selector ... :tests ... :test-m
ert-run-tests((not (or (tag :expensive-test) (tag :unstable) (tag :n
ert-run-tests-batch((not (or (tag :expensive-test) (tag :unstable) (
ert-run-tests-batch-and-exit((not (or (tag :expensive-test) (tag :un
eval((ert-run-tests-batch-and-exit '(not (or (tag :expensive-test) (
command-line-1(("-L" ":." "-l" "ert" "--eval" "(setq treesit-extra-l
command-line()
normal-top-level()
Test process-tests/sentinel-with-multiple-processes condition:
Info: Connection type: pty
(ert-test-failed
((should (equal calls (list ...))) :form
(equal nil ((#<process echo> "finished\n"))) :value nil :explanation
(different-types nil ((#<process echo> "finished\n")))))
FAILED 34/37 process-tests/sentinel-with-multiple-processes (0.241297 sec) at src/process-tests.el:865
passed 35/37 set-process-filter-t (1.110837 sec)
passed 36/37 start-process-should-not-modify-arguments (0.001001 sec)
passed 37/37 unibyte-domain-name (0.016113 sec)
Ran 37 tests, 34 results as expected, 1 unexpected, 2 skipped (2024-07-03 02:45:38-0500, 2.657456 sec)
1 unexpected results:
FAILED process-tests/sentinel-with-multiple-processes
2 skipped results:
SKIPPED make-process-w32-debug-spawn-error
SKIPPED process-sentinel-interrupt-event
[-- Attachment #3: process-tests-2.log --]
[-- Type: text/plain, Size: 2904 bytes --]
Running 37 tests (2024-06-29 18:49:19+0200, selector `(not (or (tag :expensive-test) (tag :unstable) (tag :nativecomp)))')
passed 1/37 lookup-family-specification (0.000518 sec)
passed 2/37 lookup-google (0.010568 sec)
passed 3/37 lookup-hints-specification (0.000154 sec)
localhost/0 Name or service not known
localhost/0 Name or service not known
343.1.2.3/0 Name or service not known
343.1.2.3/0 Name or service not known
1.2.3.4.5/0 Name or service not known
1.2.3.4.5/0 Name or service not known
fe80::1/0 Address family for hostname not supported
e301::203:1/0 Address family for hostname not supported
e301:203::1/0 Address family for hostname not supported
e301:0203::1/0 Address family for hostname not supported
::1/0 Address family for hostname not supported
::0/0 Address family for hostname not supported
0343:1:2::3/0 Address family for hostname not supported
343:001:2::3/0 Address family for hostname not supported
passed 4/37 lookup-hints-values (0.000272 sec)
passed 5/37 lookup-unicode-domains (0.124601 sec)
skipped 6/37 make-process-w32-debug-spawn-error (0.000133 sec)
passed 7/37 make-process/connection-type/in-pty (0.002294 sec)
passed 8/37 make-process/connection-type/out-pty (0.001549 sec)
passed 9/37 make-process/connection-type/out-pty-with-stderr-buffer (0.001336 sec)
passed 10/37 make-process/connection-type/pipe (0.001688 sec)
passed 11/37 make-process/connection-type/pipe-2 (0.002292 sec)
passed 12/37 make-process/connection-type/pty (0.001713 sec)
passed 13/37 make-process/connection-type/pty-2 (0.001550 sec)
passed 14/37 make-process/connection-type/pty-with-stderr-buffer (0.001428 sec)
passed 15/37 make-process/file-handler/disable (0.000328 sec)
passed 16/37 make-process/file-handler/found (0.000075 sec)
passed 17/37 make-process/file-handler/not-found (0.004593 sec)
passed 18/37 make-process/mix-stderr (0.005268 sec)
passed 19/37 make-process/noquery-stderr (0.004517 sec)
passed 20/37 make-process/stop (0.000071 sec)
emacs.invalid/0 Name or service not known
passed 21/37 non-existent-lookup-failure (0.006915 sec)
passed 22/37 process-num-processors (0.000069 sec)
skipped 23/37 process-sentinel-interrupt-event (0.000064 sec)
passed 24/37 process-test-sentinel-accept-process-output (0.001387 sec)
passed 25/37 process-test-sentinel-sit-for (0.010667 sec)
passed 26/37 process-test-stderr-buffer (0.001688 sec)
passed 27/37 process-test-stderr-filter (0.001644 sec)
passed 28/37 process-tests/fd-setsize-no-crash/make-network-process (0.013212 sec)
passed 29/37 process-tests/fd-setsize-no-crash/make-pipe-process (0.013785 sec)
passed 30/37 process-tests/fd-setsize-no-crash/make-process (0.036187 sec)
passed 31/37 process-tests/fd-setsize-no-crash/make-serial-process (0.017596 sec)
^ permalink raw reply [flat|nested] 3+ messages in thread
* bug#71942: 30.0.60; Intermittent failure in process-tests
2024-07-04 19:34 bug#71942: 30.0.60; Intermittent failure in process-tests john muhl
@ 2024-07-05 7:55 ` Andrea Corallo
2024-07-05 16:30 ` john muhl
0 siblings, 1 reply; 3+ messages in thread
From: Andrea Corallo @ 2024-07-05 7:55 UTC (permalink / raw)
To: john muhl; +Cc: Philipp Stephani, 71942
john muhl <jm@pub.pink> writes:
> The failure is in ‘process-tests/sentinel-with-multiple-processes’
> and happens on all the configurations being tested. It happens in
> both ‘make check’ and running the test individually. It can be
> reproduced using a script like:
>
> #!/usr/bin/env bash
> echo OK >> ~/tmp/process-tests.txt
> cd ~/src/emacs
> rm -f test/src/process-tests.log
> make test/src/process-tests.log
>
> and the command ‘watch -e script.sh’. For an idea how often it
> fails here are the results of five runs of the above on two
> different machines:
>
> wc -l process-tests-*.txt
> 157 process-tests-1.txt
> 259 process-tests-2.txt
> 329 process-tests-3.txt
> 112 process-tests-4.txt
> 96 process-tests-5.txt
> 950 total
>
> wc -l process-tests-*.txt
> 11 process-tests-1.txt
> 14 process-tests-2.txt
> 9 process-tests-3.txt
> 11 process-tests-4.txt
> 11 process-tests-5.txt
> 56 total
Hi john,
what happens you increase the 10 seconds sleep-for into
process-tests/sentinel-with-multiple-processes?
Cc-ing Philipp
Andrea
^ permalink raw reply [flat|nested] 3+ messages in thread
* bug#71942: 30.0.60; Intermittent failure in process-tests
2024-07-05 7:55 ` Andrea Corallo
@ 2024-07-05 16:30 ` john muhl
0 siblings, 0 replies; 3+ messages in thread
From: john muhl @ 2024-07-05 16:30 UTC (permalink / raw)
To: Andrea Corallo; +Cc: Philipp Stephani, 71942
Andrea Corallo <acorallo@gnu.org> writes:
>
> what happens you increase the 10 seconds sleep-for into
> process-tests/sentinel-with-multiple-processes?
Tried with 100 and 1000. It doesn’t change much.
# (sleep-for 10)
wc -l process-tests-*.txt
157 process-tests-1.txt
259 process-tests-2.txt
329 process-tests-3.txt
112 process-tests-4.txt
96 process-tests-5.txt
950 total
# (sleep-for 100)
wc -l process-tests-*.txt
29 process-tests-1.txt
70 process-tests-2.txt
93 process-tests-3.txt
553 process-tests-4.txt
262 process-tests-5.txt
1007 total
# (sleep-for 1000)
wc -l process-tests-*.txt
34 process-tests-1.txt
196 process-tests-2.txt
94 process-tests-3.txt
132 process-tests-4.txt
250 process-tests-5.txt
706 total
# (sleep-for 10)
wc -l process-tests-*.txt
11 process-tests-1.txt
14 process-tests-2.txt
9 process-tests-3.txt
11 process-tests-4.txt
11 process-tests-5.txt
56 total
# (sleep-for 100)
wc -l process-tests-*.txt
139 process-tests-1.txt
15 process-tests-2.txt
57 process-tests-3.txt
106 process-tests-4.txt
105 process-tests-5.txt
422 total
# (sleep-for 1000)
wc -l process-tests-*.txt
117 process-tests-1.txt
207 process-tests-2.txt
24 process-tests-3.txt
15 process-tests-4.txt
11 process-tests-5.txt
374 total
^ permalink raw reply [flat|nested] 3+ messages in thread
end of thread, other threads:[~2024-07-05 16:30 UTC | newest]
Thread overview: 3+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2024-07-04 19:34 bug#71942: 30.0.60; Intermittent failure in process-tests john muhl
2024-07-05 7:55 ` Andrea Corallo
2024-07-05 16:30 ` john muhl
Code repositories for project(s) associated with this external index
https://git.savannah.gnu.org/cgit/emacs.git
https://git.savannah.gnu.org/cgit/emacs/org-mode.git
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.