all messages for Emacs-related lists mirrored at yhetil.org
 help / color / mirror / code / Atom feed
From: Eli Zaretskii <eliz@gnu.org>
To: Philipp Stephani <phst@google.com>
Cc: 23205@debbugs.gnu.org
Subject: bug#23205: 25.0.92; sort-tests is flaky
Date: Sun, 03 Apr 2016 17:57:38 +0300	[thread overview]
Message-ID: <83a8larb8d.fsf@gnu.org> (raw)
In-Reply-To: <CAP-RRPsmUS0=RjW9a3-RFx6nSjNxMR=j__kORqZm3r3v+W9YRA@mail.gmail.com> (message from Philipp Stephani on Sun, 03 Apr 2016 10:30:10 +0000)

> From: Philipp Stephani <phst@google.com>
> Date: Sun, 03 Apr 2016 10:30:10 +0000
> 
> In the emacs-25 branch, in the directory test/automated, run: 
> 
> declare -i failures=0 
> for ((i=0; i<1000; i++)); do 
> if ! output="$(make sort-tests 2>&1)"; then 
> ((failures++)) 
> echo "Iteration $i: $output" 
> fi 
> done 
> echo "Failures: $failures" 
> 
> There will be typically a small number of failures (< 10), caused by 
> e.g. 
> 
> Test sort-tests--lines condition: 
> (ert-test-failed 
> ((should 
> (string= 
> (substring ... 0 -1) 
> sorted-words)) 
> :form 
> (string= "Zi 
> zI" "zI 
> Zi") 
> :value nil)) 
> 
> This is presumably due to non-stable sorting. Either the sorting should 
> be made stable, or the test shouldn't assume stable sorting. 

Do you sometimes see such failures if you just run the test once?





  reply	other threads:[~2016-04-03 14:57 UTC|newest]

Thread overview: 7+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2016-04-03 10:30 bug#23205: 25.0.92; sort-tests is flaky Philipp Stephani
2016-04-03 14:57 ` Eli Zaretskii [this message]
2016-04-03 21:00   ` Philipp Stephani
2016-04-04  2:33     ` Eli Zaretskii
2016-04-04 16:29       ` Philipp Stephani
2016-04-06  8:31 ` Paul Eggert
2016-04-06 11:34   ` Philipp Stephani

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=83a8larb8d.fsf@gnu.org \
    --to=eliz@gnu.org \
    --cc=23205@debbugs.gnu.org \
    --cc=phst@google.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
Code repositories for project(s) associated with this external index

	https://git.savannah.gnu.org/cgit/emacs.git
	https://git.savannah.gnu.org/cgit/emacs/org-mode.git

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.