From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!not-for-mail From: Philipp Stephani Newsgroups: gmane.emacs.bugs Subject: bug#23205: 25.0.92; sort-tests is flaky Date: Sun, 03 Apr 2016 10:30:10 +0000 Message-ID: NNTP-Posting-Host: plane.gmane.org Mime-Version: 1.0 Content-Type: multipart/alternative; boundary=001a11347b0e745442052f9219ff X-Trace: ger.gmane.org 1459679513 10476 80.91.229.3 (3 Apr 2016 10:31:53 GMT) X-Complaints-To: usenet@ger.gmane.org NNTP-Posting-Date: Sun, 3 Apr 2016 10:31:53 +0000 (UTC) To: 23205@debbugs.gnu.org Original-X-From: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane.org@gnu.org Sun Apr 03 12:31:39 2016 Return-path: Envelope-to: geb-bug-gnu-emacs@m.gmane.org Original-Received: from lists.gnu.org ([208.118.235.17]) by plane.gmane.org with esmtp (Exim 4.69) (envelope-from ) id 1amfJi-0008Ox-JU for geb-bug-gnu-emacs@m.gmane.org; Sun, 03 Apr 2016 12:31:38 +0200 Original-Received: from localhost ([::1]:52785 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1amfJi-00014i-2O for geb-bug-gnu-emacs@m.gmane.org; Sun, 03 Apr 2016 06:31:38 -0400 Original-Received: from eggs.gnu.org ([2001:4830:134:3::10]:56750) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1amfJ9-0000AI-K6 for bug-gnu-emacs@gnu.org; Sun, 03 Apr 2016 06:31:05 -0400 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1amfJ8-0001VX-70 for bug-gnu-emacs@gnu.org; Sun, 03 Apr 2016 06:31:03 -0400 Original-Received: from debbugs.gnu.org ([208.118.235.43]:52325) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1amfJ8-0001VT-3c for bug-gnu-emacs@gnu.org; Sun, 03 Apr 2016 06:31:02 -0400 Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1amfJ7-0007PU-T2 for bug-gnu-emacs@gnu.org; Sun, 03 Apr 2016 06:31:01 -0400 X-Loop: help-debbugs@gnu.org Resent-From: Philipp Stephani Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Sun, 03 Apr 2016 10:31:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: report 23205 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: X-Debbugs-Original-To: bug-gnu-emacs@gnu.org Original-Received: via spool by submit@debbugs.gnu.org id=B.145967943728448 (code B ref -1); Sun, 03 Apr 2016 10:31:01 +0000 Original-Received: (at submit) by debbugs.gnu.org; 3 Apr 2016 10:30:37 +0000 Original-Received: from localhost ([127.0.0.1]:49452 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1amfIi-0007Ol-PM for submit@debbugs.gnu.org; Sun, 03 Apr 2016 06:30:37 -0400 Original-Received: from eggs.gnu.org ([208.118.235.92]:37472) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1amfIg-0007OZ-E0 for submit@debbugs.gnu.org; Sun, 03 Apr 2016 06:30:34 -0400 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1amfIZ-0001Sd-OB for submit@debbugs.gnu.org; Sun, 03 Apr 2016 06:30:29 -0400 Original-Received: from lists.gnu.org ([2001:4830:134:3::11]:33171) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1amfIZ-0001SZ-Ki for submit@debbugs.gnu.org; Sun, 03 Apr 2016 06:30:27 -0400 Original-Received: from eggs.gnu.org ([2001:4830:134:3::10]:56670) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1amfIX-00087I-L9 for bug-gnu-emacs@gnu.org; Sun, 03 Apr 2016 06:30:27 -0400 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1amfIW-0001S7-2C for bug-gnu-emacs@gnu.org; Sun, 03 Apr 2016 06:30:25 -0400 Original-Received: from mail-lb0-x232.google.com ([2a00:1450:4010:c04::232]:33503) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1amfIV-0001Rv-LE for bug-gnu-emacs@gnu.org; Sun, 03 Apr 2016 06:30:23 -0400 Original-Received: by mail-lb0-x232.google.com with SMTP id u8so120305665lbk.0 for ; Sun, 03 Apr 2016 03:30:23 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:from:date:message-id:subject:to; bh=Bh3flRn3kWrmm2uhMHVLOrFAQfJ3J4FAUqCGGxeDhMw=; b=mvL0kx8Pk29geiOt/Fw0PPNUw58ucnKlgVjcXb3Wrf38CxbMss0sIJW+fFC7UN7jv6 NUUS70p4SkkL/fuJOKqvb1z5nBqtY+RXAmbhrOTb6O2KzpEZk/wtR1jO/+j0k6lpCzl/ VWBKxr6U3WQdMliP0gczAbHlUJzjN0hnFKZ4lRINmt9/lEeh7qcFqxMO4p3U/Lw1ajqp SXopvKVstGkQNsj8KKssxcN4vSQ9sInF+LBK3EqCEoi+XQ3+1RKFCSJqrlFkBNVkZdmU AUVSkyXNcLpmP2t7Jay5tIR55kAoHwu0AWaJF2ttHD/makgtq+yMFUZShIiIWtYUP/Jd aMHg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=Bh3flRn3kWrmm2uhMHVLOrFAQfJ3J4FAUqCGGxeDhMw=; b=O9NBGABLMC4LQMaasXaJWpYVzi1RgBmqh+vmforRo+Ycf9m+FZ3iI0X/7SU9+pCFuh n8JX9AaFtQ9Db9zJ2hkEwOkf+MnkbmE/Jd4iZth0M6LG9guvsC74rbunyhFLqKoKWe9s FF0uptTZvr2jzgl13oTCmVGD9OdGIBlLf2EBdf/7Yt8u7w09xKNqS3EDKBmaNJ/HHApG gIOhFw6x7A7q+1qmmcTbqsf1ScwN7qm1xR3dKjO/DsN+GswJs8AzUBudxDwooxvsOiJV L5p/kpYKA7zVVbFKg7U03Kxg4OjEu/q3lvW7teRllMRlVtPcvFziOqJ24MzlB4eDUyWc kXRQ== X-Gm-Message-State: AD7BkJJ9cX8hCTsOpoawrrx7AbQhV/zNv6CwlcODgEIfEKKYgIKrqD69rzqhlU7rsprF5DTnpoWekt3/O6sPnNiB X-Received: by 10.112.67.1 with SMTP id j1mr737284lbt.103.1459679422314; Sun, 03 Apr 2016 03:30:22 -0700 (PDT) X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 208.118.235.43 X-BeenThere: bug-gnu-emacs@gnu.org List-Id: "Bug reports for GNU Emacs, the Swiss army knife of text editors" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane.org@gnu.org Original-Sender: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane.org@gnu.org Xref: news.gmane.org gmane.emacs.bugs:115919 Archived-At: --001a11347b0e745442052f9219ff Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable In the emacs-25 branch, in the directory test/automated, run: declare -i failures=3D0 for ((i=3D0; i<1000; i++)); do if ! output=3D"$(make sort-tests 2>&1)"; then ((failures++)) echo "Iteration $i: $output" fi done echo "Failures: $failures" There will be typically a small number of failures (< 10), caused by e.g. Test sort-tests--lines condition: (ert-test-failed ((should (string=3D (substring ... 0 -1) sorted-words)) :form (string=3D "Zi zI" "zI Zi") :value nil)) This is presumably due to non-stable sorting. Either the sorting should be made stable, or the test shouldn't assume stable sorting. In GNU Emacs 25.0.92.1 (x86_64-unknown-linux-gnu, GTK+ Version 3.10.8) of 2016-03-24 built on localhost Repository revision: 077b78cffc0711717ae8976ef302b788e88d27a8 Windowing system distributor 'The X.Org Foundation', version 11.0.11701000 System Description: Ubuntu 14.04 LTS Configured features: XPM JPEG TIFF GIF PNG SOUND GSETTINGS NOTIFY FREETYPE XFT ZLIB TOOLKIT_SCROLL_BARS GTK3 X11 Important settings: value of $LANG: en_US.UTF-8 locale-coding-system: utf-8-unix Major mode: Lisp Interaction Minor modes in effect: tooltip-mode: t global-eldoc-mode: t electric-indent-mode: t mouse-wheel-mode: t tool-bar-mode: t menu-bar-mode: t file-name-shadow-mode: t global-font-lock-mode: t font-lock-mode: t blink-cursor-mode: t auto-composition-mode: t auto-encryption-mode: t auto-compression-mode: t line-number-mode: t transient-mark-mode: t Recent messages: For information about GNU Emacs and the GNU system, type C-h C-a. Load-path shadows: None found. Features: (shadow sort mail-extr emacsbug message dired format-spec rfc822 mml mml-sec password-cache epg epg-config gnus-util mm-decode mm-bodies mm-encode mail-parse rfc2231 mailabbrev gmm-utils mailheader sendmail rfc2047 rfc2045 ietf-drums mm-util help-fns help-mode easymenu cl-loaddefs pcase cl-lib mail-prsvr mail-utils time-date mule-util tooltip eldoc electric uniquify ediff-hook vc-hooks lisp-float-type mwheel x-win term/common-win x-dnd tool-bar dnd fontset image regexp-opt fringe tabulated-list newcomment elisp-mode lisp-mode prog-mode register page menu-bar rfn-eshadow timer select scroll-bar mouse jit-lock font-lock syntax facemenu font-core frame cl-generic cham georgian utf-8-lang misc-lang vietnamese tibetan thai tai-viet lao korean japanese eucjp-ms cp51932 hebrew greek romanian slovak czech european ethiopic indian cyrillic chinese charscript case-table epa-hook jka-cmpr-hook help simple abbrev minibuffer cl-preloaded nadvice loaddefs button faces cus-face macroexp files text-properties overlay sha1 md5 base64 format env code-pages mule custom widget hashtable-print-readable backquote inotify dynamic-setting system-font-setting font-render-setting move-toolbar gtk x-toolkit x multi-tty make-network-process emacs) Memory information: ((conses 16 87235 4859) (symbols 48 19673 0) (miscs 40 278 121) (strings 32 14530 4256) (string-bytes 1 423141) (vectors 16 11958) (vector-slots 8 433605 5930) (floats 8 162 10) (intervals 56 184 0) (buffers 976 11) (heap 1024 50063 1046)) --=20 Google Germany GmbH Erika-Mann-Stra=C3=9Fe 33 80636 M=C3=BCnchen Registergericht und -nummer: Hamburg, HRB 86891 Sitz der Gesellschaft: Hamburg Gesch=C3=A4ftsf=C3=BChrer: Matthew Scott Sucherman, Paul Terence Manicle Diese E-Mail ist vertraulich. Wenn Sie nicht der richtige Adressat sind, leiten Sie diese bitte nicht weiter, informieren Sie den Absender und l=C3=B6schen Sie die E-Mail und alle Anh=C3=A4nge. Vielen Dank. This e-mail is confidential. If you are not the right addressee please do not forward it, please inform the sender, and please erase this e-mail including any attachments. Thanks. --001a11347b0e745442052f9219ff Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable


In the emacs-25 branch, in the directory test/automated, run:

declare -i failures=3D0
for ((i=3D0; i<1000; i++)); do
if ! output=3D"$(make sort-tests 2>&1)"; then
((failures++))
echo "Iteration $i: $output"
fi
done
echo "Failures: $failures"

There will be typically a small number of failures (< 10), caused by
e.g.

Test sort-tests--lines condition:
(ert-test-failed
((should
(string=3D
(substring ... 0 -1)
sorted-words))
:form
(string=3D "Zi
zI" "zI
Zi")
:value nil))

This is presumably due to non-stable sorting. Either the sorting shoul= d
be made stable, or the test shouldn't assume stable sorting.



In GNU Emacs 25.0.92.1 (x86_64-unknown-linux-gnu, GTK+ Version 3.10.8)
of 2016-03-24 built on localhost
Repository revision: 077b78cffc0711717ae8976ef302b788e88d27a8
Windowing system distributor 'The X.Org Foundation', version 11= .0.11701000
System Description: Ubuntu 14.04 LTS

Configured features:
XPM JPEG TIFF GIF PNG SOUND GSETTINGS NOTIFY FREETYPE XFT ZLIB
TOOLKIT_SCROLL_BARS GTK3 X11

Important settings:
value of $LANG: en_US.UTF-8
locale-coding-system: utf-8-unix

Major mode: Lisp Interaction

Minor modes in effect:
tooltip-mode: t
global-eldoc-mode: t
electric-indent-mode: t
mouse-wheel-mode: t
tool-bar-mode: t
menu-bar-mode: t
file-name-shadow-mode: t
global-font-lock-mode: t
font-lock-mode: t
blink-cursor-mode: t
auto-composition-mode: t
auto-encryption-mode: t
auto-compression-mode: t
line-number-mode: t
transient-mark-mode: t

Recent messages:
For information about GNU Emacs and the GNU system, type C-h C-a.

Load-path shadows:
None found.

Features:
(shadow sort mail-extr emacsbug message dired format-spec rfc822 mml
mml-sec password-cache epg epg-config gnus-util mm-decode mm-bodies
mm-encode mail-parse rfc2231 mailabbrev gmm-utils mailheader sendmail
rfc2047 rfc2045 ietf-drums mm-util help-fns help-mode easymenu
cl-loaddefs pcase cl-lib mail-prsvr mail-utils time-date mule-util
tooltip eldoc electric uniquify ediff-hook vc-hooks lisp-float-type
mwheel x-win term/common-win x-dnd tool-bar dnd fontset image regexp-op= t
fringe tabulated-list newcomment elisp-mode lisp-mode prog-mode registe= r
page menu-bar rfn-eshadow timer select scroll-bar mouse jit-lock
font-lock syntax facemenu font-core frame cl-generic cham georgian
utf-8-lang misc-lang vietnamese tibetan thai tai-viet lao korean
japanese eucjp-ms cp51932 hebrew greek romanian slovak czech european
ethiopic indian cyrillic chinese charscript case-table epa-hook
jka-cmpr-hook help simple abbrev minibuffer cl-preloaded nadvice
loaddefs button faces cus-face macroexp files text-properties overlay
sha1 md5 base64 format env code-pages mule custom widget
hashtable-print-readable backquote inotify dynamic-setting
system-font-setting font-render-setting move-toolbar gtk x-toolkit x
multi-tty make-network-process emacs)

Memory information:
((conses 16 87235 4859)
(symbols 48 19673 0)
(miscs 40 278 121)
(strings 32 14530 4256)
(string-bytes 1 423141)
(vectors 16 11958)
(vector-slots 8 433605 5930)
(floats 8 162 10)
(intervals 56 184 0)
(buffers 976 11)
(heap 1024 50063 1046))
--

Goo= gle Germany GmbH
Erika-Mann-Stra=C3=9Fe 33
80636 M=C3=BCnchen

Registergericht und -nummer: Hamburg, HRB 86891
Sitz der Gesellschaft: Hamburg
Gesch=C3=A4ftsf=C3=BChrer: Matthew Scott Sucherman, Paul Terence Manicle

Diese E-Mail ist vertraulich. Wenn Sie nicht der richtige Ad= ressat sind, leiten Sie diese bitte nicht weiter, informieren Sie den Absen= der und l=C3=B6schen Sie die E-Mail und alle Anh=C3=A4nge. Vielen Dank.

This e-mail is confidential. If you are not the right addres= see please do not forward it, please inform the sender, and please erase th= is e-mail including any attachments. Thanks.

--001a11347b0e745442052f9219ff--