unofficial mirror of bug-gnu-emacs@gnu.org 
 help / color / mirror / code / Atom feed
* bug#71942: 30.0.60; Intermittent failure in process-tests
@ 2024-07-04 19:34 john muhl
  2024-07-05  7:55 ` Andrea Corallo
  0 siblings, 1 reply; 3+ messages in thread
From: john muhl @ 2024-07-04 19:34 UTC (permalink / raw)
  To: 71942

[-- Attachment #1: Type: text/plain, Size: 928 bytes --]

The failure is in ‘process-tests/sentinel-with-multiple-processes’
and happens on all the configurations being tested. It happens in
both ‘make check’ and running the test individually. It can be
reproduced using a script like:

  #!/usr/bin/env bash
  echo OK >> ~/tmp/process-tests.txt
  cd ~/src/emacs
  rm -f test/src/process-tests.log
  make test/src/process-tests.log

and the command ‘watch -e script.sh’. For an idea how often it
fails here are the results of five runs of the above on two
different machines:

  wc -l process-tests-*.txt
    157 process-tests-1.txt
    259 process-tests-2.txt
    329 process-tests-3.txt
    112 process-tests-4.txt
     96 process-tests-5.txt
    950 total

  wc -l process-tests-*.txt
     11 process-tests-1.txt
     14 process-tests-2.txt
      9 process-tests-3.txt
     11 process-tests-4.txt
     11 process-tests-5.txt
     56 total


[-- Attachment #2: process-tests-1.log --]
[-- Type: text/plain, Size: 4910 bytes --]

Running 37 tests (2024-07-03 02:45:36-0500, selector `(not (or (tag :expensive-test) (tag :unstable) (tag :nativecomp)))')
   passed   1/37  lookup-family-specification (0.000848 sec)
   passed   2/37  lookup-google (0.012795 sec)
   passed   3/37  lookup-hints-specification (0.000481 sec)
localhost/0 Name or service not known
localhost/0 Name or service not known
343.1.2.3/0 Name or service not known
343.1.2.3/0 Name or service not known
1.2.3.4.5/0 Name or service not known
1.2.3.4.5/0 Name or service not known
fe80::1/0 Address family for hostname not supported
e301::203:1/0 Address family for hostname not supported
e301:203::1/0 Address family for hostname not supported
e301:0203::1/0 Address family for hostname not supported
::1/0 Address family for hostname not supported
::0/0 Address family for hostname not supported
0343:1:2::3/0 Address family for hostname not supported
343:001:2::3/0 Address family for hostname not supported
   passed   4/37  lookup-hints-values (0.000875 sec)
   passed   5/37  lookup-unicode-domains (0.356801 sec)
  skipped   6/37  make-process-w32-debug-spawn-error (0.000212 sec)
   passed   7/37  make-process/connection-type/in-pty (0.002656 sec)
   passed   8/37  make-process/connection-type/out-pty (0.002723 sec)
   passed   9/37  make-process/connection-type/out-pty-with-stderr-buffer (0.002729 sec)
   passed  10/37  make-process/connection-type/pipe (0.002522 sec)
   passed  11/37  make-process/connection-type/pipe-2 (0.002597 sec)
   passed  12/37  make-process/connection-type/pty (0.002545 sec)
   passed  13/37  make-process/connection-type/pty-2 (0.002701 sec)
   passed  14/37  make-process/connection-type/pty-with-stderr-buffer (0.003489 sec)
   passed  15/37  make-process/file-handler/disable (0.000826 sec)
   passed  16/37  make-process/file-handler/found (0.000227 sec)
   passed  17/37  make-process/file-handler/not-found (0.008194 sec)
   passed  18/37  make-process/mix-stderr (0.019879 sec)
   passed  19/37  make-process/noquery-stderr (0.010120 sec)
   passed  20/37  make-process/stop (0.000331 sec)
emacs.invalid/0 Name or service not known
   passed  21/37  non-existent-lookup-failure (0.032796 sec)
   passed  22/37  process-num-processors (0.000285 sec)
  skipped  23/37  process-sentinel-interrupt-event (0.000287 sec)
   passed  24/37  process-test-sentinel-accept-process-output (0.008299 sec)
   passed  25/37  process-test-sentinel-sit-for (0.026713 sec)
   passed  26/37  process-test-stderr-buffer (0.005043 sec)
   passed  27/37  process-test-stderr-filter (0.005920 sec)
   passed  28/37  process-tests/fd-setsize-no-crash/make-network-process (0.032965 sec)
   passed  29/37  process-tests/fd-setsize-no-crash/make-pipe-process (0.026318 sec)
   passed  30/37  process-tests/fd-setsize-no-crash/make-process (0.084728 sec)
   passed  31/37  process-tests/fd-setsize-no-crash/make-serial-process (0.038348 sec)
   passed  32/37  process-tests/multiple-threads-waiting (0.017314 sec)
   passed  33/37  process-tests/sentinel-called (0.211271 sec)
Test process-tests/sentinel-with-multiple-processes backtrace:
  signal(ert-test-failed (((should (equal calls (list (list process "f
  ert-fail(((should (equal calls (list (list process "finished\n")))) 
  #f(compiled-function () #<bytecode 0x16a62428>)()
  #f(compiled-function () #<bytecode 0x1b97372a>)()
  handler-bind-1(#f(compiled-function () #<bytecode 0x1b97372a>) (erro
  ert--run-test-internal(#s(ert--test-execution-info :test #s(ert-test
  ert-run-test(#s(ert-test :name process-tests/sentinel-with-multiple-
  ert-run-or-rerun-test(#s(ert--stats :selector ... :tests ... :test-m
  ert-run-tests((not (or (tag :expensive-test) (tag :unstable) (tag :n
  ert-run-tests-batch((not (or (tag :expensive-test) (tag :unstable) (
  ert-run-tests-batch-and-exit((not (or (tag :expensive-test) (tag :un
  eval((ert-run-tests-batch-and-exit '(not (or (tag :expensive-test) (
  command-line-1(("-L" ":." "-l" "ert" "--eval" "(setq treesit-extra-l
  command-line()
  normal-top-level()
Test process-tests/sentinel-with-multiple-processes condition:
    Info: Connection type: pty
    (ert-test-failed
     ((should (equal calls (list ...))) :form
      (equal nil ((#<process echo> "finished\n"))) :value nil :explanation
      (different-types nil ((#<process echo> "finished\n")))))
   FAILED  34/37  process-tests/sentinel-with-multiple-processes (0.241297 sec) at src/process-tests.el:865
   passed  35/37  set-process-filter-t (1.110837 sec)
   passed  36/37  start-process-should-not-modify-arguments (0.001001 sec)
   passed  37/37  unibyte-domain-name (0.016113 sec)

Ran 37 tests, 34 results as expected, 1 unexpected, 2 skipped (2024-07-03 02:45:38-0500, 2.657456 sec)

1 unexpected results:
   FAILED  process-tests/sentinel-with-multiple-processes

2 skipped results:
  SKIPPED  make-process-w32-debug-spawn-error
  SKIPPED  process-sentinel-interrupt-event


[-- Attachment #3: process-tests-2.log --]
[-- Type: text/plain, Size: 2904 bytes --]

Running 37 tests (2024-06-29 18:49:19+0200, selector `(not (or (tag :expensive-test) (tag :unstable) (tag :nativecomp)))')
   passed   1/37  lookup-family-specification (0.000518 sec)
   passed   2/37  lookup-google (0.010568 sec)
   passed   3/37  lookup-hints-specification (0.000154 sec)
localhost/0 Name or service not known
localhost/0 Name or service not known
343.1.2.3/0 Name or service not known
343.1.2.3/0 Name or service not known
1.2.3.4.5/0 Name or service not known
1.2.3.4.5/0 Name or service not known
fe80::1/0 Address family for hostname not supported
e301::203:1/0 Address family for hostname not supported
e301:203::1/0 Address family for hostname not supported
e301:0203::1/0 Address family for hostname not supported
::1/0 Address family for hostname not supported
::0/0 Address family for hostname not supported
0343:1:2::3/0 Address family for hostname not supported
343:001:2::3/0 Address family for hostname not supported
   passed   4/37  lookup-hints-values (0.000272 sec)
   passed   5/37  lookup-unicode-domains (0.124601 sec)
  skipped   6/37  make-process-w32-debug-spawn-error (0.000133 sec)
   passed   7/37  make-process/connection-type/in-pty (0.002294 sec)
   passed   8/37  make-process/connection-type/out-pty (0.001549 sec)
   passed   9/37  make-process/connection-type/out-pty-with-stderr-buffer (0.001336 sec)
   passed  10/37  make-process/connection-type/pipe (0.001688 sec)
   passed  11/37  make-process/connection-type/pipe-2 (0.002292 sec)
   passed  12/37  make-process/connection-type/pty (0.001713 sec)
   passed  13/37  make-process/connection-type/pty-2 (0.001550 sec)
   passed  14/37  make-process/connection-type/pty-with-stderr-buffer (0.001428 sec)
   passed  15/37  make-process/file-handler/disable (0.000328 sec)
   passed  16/37  make-process/file-handler/found (0.000075 sec)
   passed  17/37  make-process/file-handler/not-found (0.004593 sec)
   passed  18/37  make-process/mix-stderr (0.005268 sec)
   passed  19/37  make-process/noquery-stderr (0.004517 sec)
   passed  20/37  make-process/stop (0.000071 sec)
emacs.invalid/0 Name or service not known
   passed  21/37  non-existent-lookup-failure (0.006915 sec)
   passed  22/37  process-num-processors (0.000069 sec)
  skipped  23/37  process-sentinel-interrupt-event (0.000064 sec)
   passed  24/37  process-test-sentinel-accept-process-output (0.001387 sec)
   passed  25/37  process-test-sentinel-sit-for (0.010667 sec)
   passed  26/37  process-test-stderr-buffer (0.001688 sec)
   passed  27/37  process-test-stderr-filter (0.001644 sec)
   passed  28/37  process-tests/fd-setsize-no-crash/make-network-process (0.013212 sec)
   passed  29/37  process-tests/fd-setsize-no-crash/make-pipe-process (0.013785 sec)
   passed  30/37  process-tests/fd-setsize-no-crash/make-process (0.036187 sec)
   passed  31/37  process-tests/fd-setsize-no-crash/make-serial-process (0.017596 sec)

^ permalink raw reply	[flat|nested] 3+ messages in thread

* bug#71942: 30.0.60; Intermittent failure in process-tests
  2024-07-04 19:34 bug#71942: 30.0.60; Intermittent failure in process-tests john muhl
@ 2024-07-05  7:55 ` Andrea Corallo
  2024-07-05 16:30   ` john muhl
  0 siblings, 1 reply; 3+ messages in thread
From: Andrea Corallo @ 2024-07-05  7:55 UTC (permalink / raw)
  To: john muhl; +Cc: Philipp Stephani, 71942

john muhl <jm@pub.pink> writes:

> The failure is in ‘process-tests/sentinel-with-multiple-processes’
> and happens on all the configurations being tested. It happens in
> both ‘make check’ and running the test individually. It can be
> reproduced using a script like:
>
>   #!/usr/bin/env bash
>   echo OK >> ~/tmp/process-tests.txt
>   cd ~/src/emacs
>   rm -f test/src/process-tests.log
>   make test/src/process-tests.log
>
> and the command ‘watch -e script.sh’. For an idea how often it
> fails here are the results of five runs of the above on two
> different machines:
>
>   wc -l process-tests-*.txt
>     157 process-tests-1.txt
>     259 process-tests-2.txt
>     329 process-tests-3.txt
>     112 process-tests-4.txt
>      96 process-tests-5.txt
>     950 total
>
>   wc -l process-tests-*.txt
>      11 process-tests-1.txt
>      14 process-tests-2.txt
>       9 process-tests-3.txt
>      11 process-tests-4.txt
>      11 process-tests-5.txt
>      56 total

Hi john,

what happens you increase the 10 seconds sleep-for into
process-tests/sentinel-with-multiple-processes?

Cc-ing Philipp

  Andrea





^ permalink raw reply	[flat|nested] 3+ messages in thread

* bug#71942: 30.0.60; Intermittent failure in process-tests
  2024-07-05  7:55 ` Andrea Corallo
@ 2024-07-05 16:30   ` john muhl
  0 siblings, 0 replies; 3+ messages in thread
From: john muhl @ 2024-07-05 16:30 UTC (permalink / raw)
  To: Andrea Corallo; +Cc: Philipp Stephani, 71942

Andrea Corallo <acorallo@gnu.org> writes:
>
> what happens you increase the 10 seconds sleep-for into
> process-tests/sentinel-with-multiple-processes?

Tried with 100 and 1000. It doesn’t change much.

  # (sleep-for 10)
  wc -l process-tests-*.txt
    157 process-tests-1.txt
    259 process-tests-2.txt
    329 process-tests-3.txt
    112 process-tests-4.txt
     96 process-tests-5.txt
    950 total

  # (sleep-for 100)
  wc -l process-tests-*.txt
     29 process-tests-1.txt
     70 process-tests-2.txt
     93 process-tests-3.txt
    553 process-tests-4.txt
    262 process-tests-5.txt
   1007 total

  # (sleep-for 1000)
  wc -l process-tests-*.txt
     34 process-tests-1.txt
    196 process-tests-2.txt
     94 process-tests-3.txt
    132 process-tests-4.txt
    250 process-tests-5.txt
    706 total

  # (sleep-for 10)
  wc -l process-tests-*.txt
     11 process-tests-1.txt
     14 process-tests-2.txt
      9 process-tests-3.txt
     11 process-tests-4.txt
     11 process-tests-5.txt
     56 total

  # (sleep-for 100)
  wc -l process-tests-*.txt
    139 process-tests-1.txt
     15 process-tests-2.txt
     57 process-tests-3.txt
    106 process-tests-4.txt
    105 process-tests-5.txt
    422 total

  # (sleep-for 1000)
  wc -l process-tests-*.txt
    117 process-tests-1.txt
    207 process-tests-2.txt
     24 process-tests-3.txt
     15 process-tests-4.txt
     11 process-tests-5.txt
    374 total






^ permalink raw reply	[flat|nested] 3+ messages in thread

end of thread, other threads:[~2024-07-05 16:30 UTC | newest]

Thread overview: 3+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2024-07-04 19:34 bug#71942: 30.0.60; Intermittent failure in process-tests john muhl
2024-07-05  7:55 ` Andrea Corallo
2024-07-05 16:30   ` john muhl

Code repositories for project(s) associated with this public inbox

	https://git.savannah.gnu.org/cgit/emacs.git

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).