From: Eli Zaretskii <eliz@gnu.org>
To: Philipp Stephani <phst@google.com>
Cc: 23205@debbugs.gnu.org
Subject: bug#23205: 25.0.92; sort-tests is flaky
Date: Sun, 03 Apr 2016 17:57:38 +0300 [thread overview]
Message-ID: <83a8larb8d.fsf@gnu.org> (raw)
In-Reply-To: <CAP-RRPsmUS0=RjW9a3-RFx6nSjNxMR=j__kORqZm3r3v+W9YRA@mail.gmail.com> (message from Philipp Stephani on Sun, 03 Apr 2016 10:30:10 +0000)
> From: Philipp Stephani <phst@google.com>
> Date: Sun, 03 Apr 2016 10:30:10 +0000
>
> In the emacs-25 branch, in the directory test/automated, run:
>
> declare -i failures=0
> for ((i=0; i<1000; i++)); do
> if ! output="$(make sort-tests 2>&1)"; then
> ((failures++))
> echo "Iteration $i: $output"
> fi
> done
> echo "Failures: $failures"
>
> There will be typically a small number of failures (< 10), caused by
> e.g.
>
> Test sort-tests--lines condition:
> (ert-test-failed
> ((should
> (string=
> (substring ... 0 -1)
> sorted-words))
> :form
> (string= "Zi
> zI" "zI
> Zi")
> :value nil))
>
> This is presumably due to non-stable sorting. Either the sorting should
> be made stable, or the test shouldn't assume stable sorting.
Do you sometimes see such failures if you just run the test once?
next prev parent reply other threads:[~2016-04-03 14:57 UTC|newest]
Thread overview: 7+ messages / expand[flat|nested] mbox.gz Atom feed top
2016-04-03 10:30 bug#23205: 25.0.92; sort-tests is flaky Philipp Stephani
2016-04-03 14:57 ` Eli Zaretskii [this message]
2016-04-03 21:00 ` Philipp Stephani
2016-04-04 2:33 ` Eli Zaretskii
2016-04-04 16:29 ` Philipp Stephani
2016-04-06 8:31 ` Paul Eggert
2016-04-06 11:34 ` Philipp Stephani
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=83a8larb8d.fsf@gnu.org \
--to=eliz@gnu.org \
--cc=23205@debbugs.gnu.org \
--cc=phst@google.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
Code repositories for project(s) associated with this external index
https://git.savannah.gnu.org/cgit/emacs.git
https://git.savannah.gnu.org/cgit/emacs/org-mode.git
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.