From mboxrd@z Thu Jan 1 00:00:00 1970
Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail
From: Philipp
Newsgroups: gmane.emacs.bugs
Subject: bug#52429: 29.0.50; Flymake tests failing on macOS
Date: Sat, 11 Dec 2021 14:36:06 +0100
Message-ID:
Mime-Version: 1.0
Content-Type: text/plain
Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214";
logging-data="10677"; mail-complaints-to="usenet@ciao.gmane.io"
To: 52429@debbugs.gnu.org
Original-X-From: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Sat Dec 11 14:37:13 2021
Return-path:
Envelope-to: geb-bug-gnu-emacs@m.gmane-mx.org
Original-Received: from lists.gnu.org ([209.51.188.17])
by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
(Exim 4.92)
(envelope-from )
id 1mw2Yr-0002aK-0Q
for geb-bug-gnu-emacs@m.gmane-mx.org; Sat, 11 Dec 2021 14:37:13 +0100
Original-Received: from localhost ([::1]:45260 helo=lists1p.gnu.org)
by lists.gnu.org with esmtp (Exim 4.90_1)
(envelope-from )
id 1mw2Yo-0005ri-SB
for geb-bug-gnu-emacs@m.gmane-mx.org; Sat, 11 Dec 2021 08:37:10 -0500
Original-Received: from eggs.gnu.org ([209.51.188.92]:42926)
by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
(Exim 4.90_1) (envelope-from )
id 1mw2Yg-0005q5-Sw
for bug-gnu-emacs@gnu.org; Sat, 11 Dec 2021 08:37:02 -0500
Original-Received: from debbugs.gnu.org ([209.51.188.43]:37234)
by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128)
(Exim 4.90_1) (envelope-from )
id 1mw2Yg-0001PZ-Kl
for bug-gnu-emacs@gnu.org; Sat, 11 Dec 2021 08:37:02 -0500
Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2)
(envelope-from ) id 1mw2Yg-0005Fi-E1
for bug-gnu-emacs@gnu.org; Sat, 11 Dec 2021 08:37:02 -0500
X-Loop: help-debbugs@gnu.org
Resent-From: Philipp
Original-Sender: "Debbugs-submit"
Resent-CC: bug-gnu-emacs@gnu.org
Resent-Date: Sat, 11 Dec 2021 13:37:02 +0000
Resent-Message-ID:
Resent-Sender: help-debbugs@gnu.org
X-GNU-PR-Message: report 52429
X-GNU-PR-Package: emacs
X-Debbugs-Original-To: bug-gnu-emacs@gnu.org
Original-Received: via spool by submit@debbugs.gnu.org id=B.163922977720135
(code B ref -1); Sat, 11 Dec 2021 13:37:02 +0000
Original-Received: (at submit) by debbugs.gnu.org; 11 Dec 2021 13:36:17 +0000
Original-Received: from localhost ([127.0.0.1]:48780 helo=debbugs.gnu.org)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from )
id 1mw2Xw-0005Eg-9a
for submit@debbugs.gnu.org; Sat, 11 Dec 2021 08:36:16 -0500
Original-Received: from lists.gnu.org ([209.51.188.17]:46364)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from ) id 1mw2Xu-0005EY-Cp
for submit@debbugs.gnu.org; Sat, 11 Dec 2021 08:36:14 -0500
Original-Received: from eggs.gnu.org ([209.51.188.92]:42700)
by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
(Exim 4.90_1) (envelope-from )
id 1mw2Xs-0005N8-QH
for bug-gnu-emacs@gnu.org; Sat, 11 Dec 2021 08:36:14 -0500
Original-Received: from [2a00:1450:4864:20::436] (port=38617
helo=mail-wr1-x436.google.com)
by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128)
(Exim 4.90_1) (envelope-from )
id 1mw2Xq-0001J5-W9
for bug-gnu-emacs@gnu.org; Sat, 11 Dec 2021 08:36:12 -0500
Original-Received: by mail-wr1-x436.google.com with SMTP id q3so19413823wru.5
for ; Sat, 11 Dec 2021 05:36:10 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112;
h=from:to:subject:date:message-id:mime-version;
bh=nt6AROIyZTk/ggd2mj/Ac1v8s/I/n7CVO66s5kv06NU=;
b=QCdAcT6KIzeis2Tns8ikkSyn0gRbKEKl00/yOJFIzhXWtWtxRmmzhLXZ0ifMPsRYQr
WDeCG8m9CDP/brPsjTrIOrAQn1bq39nmEiWW5uwJFonJLKE25u1uy3TPRt0ZGiznbnM3
/o7NKhpXLSzTIAdY2KbJMzlV9xXz7Pwd5WUzX9ukh1cXSba6RQUw9ePJVBTreewbSaPI
Wb4A5f4VQ0oAU3A7g3bmqoBz74sllZ/vm7abg3OoANk4530QQ3mlCbwOux4zH+JCd/RQ
ojDTDuxqpZFJIzJv9wIfHcXWp5D1jSQ4n6HXSnqNlWQ9HIwPNQJ6I1biJvS2jQ3uxXES
yqGA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=1e100.net; s=20210112;
h=x-gm-message-state:from:to:subject:date:message-id:mime-version;
bh=nt6AROIyZTk/ggd2mj/Ac1v8s/I/n7CVO66s5kv06NU=;
b=Dnzttyttj+GjhWlW8iyqtIOfdIzEPJaEs7lVv40JJEa+kx7FEKVH5e/WIpz3aiIHsn
8b2E7Y59RQuboJcPQR8n/HA4Tbn6ljL4WbOu8rzqaFYme88el76ioZlKnq+o24W3Xhou
tejxk1KuK1xBPLioB9r94MzL9oEN9YXa17pVswkq24zhL39BlkHakUkLOEWQkqFIOSUr
1dVno/7Ao3GYo8WynYMQKqOZCqbwKa4JH0cxGTqO/RFuaQ35VjS7uYhOL3RWJlh8rNcF
xJK8Fli6kkM1LcdPdPXSKJjktnNZSxs3aaJckzO+XvGbyqCTXtoqrESTHtiNAIIo5fdk
/yJw==
X-Gm-Message-State: AOAM530roJuxcxADpbgRgJDlZIEQHdLkO/ZlFKUiqdvUHbBvmcGJZMbk
Jr3WCHsGGHzaLmpakfc34cvwUWMJ1xs=
X-Google-Smtp-Source: ABdhPJyKCQmszjJmtFru/5MjjFIuM5VeFxb1e1oFX9kA7sUQVqHhLwXshfqzGury8hxketbSKVhI+w==
X-Received: by 2002:adf:e702:: with SMTP id c2mr20585247wrm.586.1639229768160;
Sat, 11 Dec 2021 05:36:08 -0800 (PST)
Original-Received: from Philipps-MacBook-Pro.local
([2a02:2455:2a5:ba00:5d9:6746:6ba6:2428])
by smtp.gmail.com with ESMTPSA id m1sm1535873wme.39.2021.12.11.05.36.07
for
(version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
Sat, 11 Dec 2021 05:36:07 -0800 (PST)
X-Host-Lookup-Failed: Reverse DNS lookup failed for 2a00:1450:4864:20::436
(failed)
Received-SPF: pass client-ip=2a00:1450:4864:20::436;
envelope-from=p.stephani2@gmail.com; helo=mail-wr1-x436.google.com
X-Spam_score_int: -10
X-Spam_score: -1.1
X-Spam_bar: -
X-Spam_report: (-1.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1,
DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1,
FREEMAIL_ENVFROM_END_DIGIT=0.25, FREEMAIL_FROM=0.001,
RCVD_IN_DNSWL_NONE=-0.0001, RDNS_NONE=0.793, SPF_HELO_NONE=0.001,
SPF_PASS=-0.001 autolearn=no autolearn_force=no
X-Spam_action: no action
X-BeenThere: debbugs-submit@debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
X-BeenThere: bug-gnu-emacs@gnu.org
List-Id: "Bug reports for GNU Emacs,
the Swiss army knife of text editors"
List-Unsubscribe: ,
List-Archive:
List-Post:
List-Help:
List-Subscribe: ,
Errors-To: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org
Original-Sender: "bug-gnu-emacs"
Xref: news.gmane.io gmane.emacs.bugs:222118
Archived-At:
On my macOS Monterey machine, the Flymake tests partially fail, both on
the emacs-28 and the master branch. Log follows:
Running 9 tests (2021-12-11 14:25:11+0100, selector `(not (or (tag :expensive-test) (tag :unstable) (tag :nativecomp)))')
Test different-diagnostic-types backtrace:
signal(ert-test-failed (((should (eq 'flymake-error (face-at-point))
ert-fail(((should (eq 'flymake-error (face-at-point))) :form (eq fly
#f(compiled-function () #)()
flymake-tests--call-with-fixture(#f(compiled-function () #)()
ert--run-test-internal(#s(ert--test-execution-info :test #s(ert-test
ert-run-test(#s(ert-test :name different-diagnostic-types :documenta
ert-run-or-rerun-test(#s(ert--stats :selector (not (or ... ... ...))
ert-run-tests((not (or (tag :expensive-test) (tag :unstable) (tag :n
ert-run-tests-batch((not (or (tag :expensive-test) (tag :unstable) (
ert-run-tests-batch-and-exit((not (or (tag :expensive-test) (tag :un
eval((ert-run-tests-batch-and-exit '(not (or (tag :expensive-test) (
command-line-1(("-L" ":." "-l" "ert" "-l" "lisp/progmodes/flymake-te
command-line()
normal-top-level()
Test different-diagnostic-types condition:
(ert-test-failed
((should
(eq 'flymake-error
(face-at-point)))
:form
(eq flymake-error flymake-warning)
:value nil))
FAILED 1/9 different-diagnostic-types (1.273652 sec)
passed 2/9 dummy-backends (1.009144 sec)
passed 3/9 eob-region-and-trailing-newline (0.000464 sec)
Test included-c-header-files backtrace:
signal(ert-test-failed (((should (eq 'flymake-error (face-at-point))
ert-fail(((should (eq 'flymake-error (face-at-point))) :form (eq fly
#f(compiled-function () #)()
flymake-tests--call-with-fixture(#f(compiled-function () #)()
ert--run-test-internal(#s(ert--test-execution-info :test #s(ert-test
ert-run-test(#s(ert-test :name included-c-header-files :documentatio
ert-run-or-rerun-test(#s(ert--stats :selector ... :tests ... :test-m
ert-run-tests((not (or (tag :expensive-test) (tag :unstable) (tag :n
ert-run-tests-batch((not (or (tag :expensive-test) (tag :unstable) (
ert-run-tests-batch-and-exit((not (or (tag :expensive-test) (tag :un
eval((ert-run-tests-batch-and-exit '(not (or (tag :expensive-test) (
command-line-1(("-L" ":." "-l" "ert" "-l" "lisp/progmodes/flymake-te
command-line()
normal-top-level()
Test included-c-header-files condition:
(ert-test-failed
((should
(eq 'flymake-error
(face-at-point)))
:form
(eq flymake-error flymake-warning)
:value nil))
FAILED 4/9 included-c-header-files (1.091255 sec)
passed 5/9 perl-backend (1.032770 sec)
passed 6/9 recurrent-backend (1.031638 sec)
passed 7/9 ruby-backend (1.174518 sec)
passed 8/9 warning-predicate-function-gcc (1.045177 sec)
passed 9/9 warning-predicate-rx-gcc (1.089723 sec)
Ran 9 tests, 7 results as expected, 2 unexpected (2021-12-11 14:25:20+0100, 9.383207 sec)
2 unexpected results:
FAILED different-diagnostic-types
FAILED included-c-header-files
I haven't dug deeper, but this looks like the compiler returns a warning
where an error is expected. Typically such tests should mock the
compiler using canned output checked into the repository.
In GNU Emacs 29.0.50 (build 25, aarch64-apple-darwin21.1.0, NS appkit-2113.00 Version 12.0.1 (Build 21A559))
of 2021-12-11
Repository revision: 8c50016b100ec2c548ec90131e0f5fb5f4ebb5c1
Repository branch: master
Windowing system distributor 'Apple', version 10.3.2113
System Description: macOS 12.0.1
Configured using:
'configure --with-modules --without-xml2 --without-pop --with-mailutils
--enable-gcc-warnings=warn-only --enable-checking=all
--enable-check-lisp-object-type '--prefix=/tmp/\7''
Configured features:
ACL GNUTLS JSON LCMS2 MODULES NOTIFY KQUEUE NS PDUMPER PNG SQLITE3
THREADS TOOLKIT_SCROLL_BARS ZLIB
Important settings:
value of $LANG: de_DE.UTF-8
locale-coding-system: utf-8-unix
Major mode: Lisp Interaction
Minor modes in effect:
tooltip-mode: t
global-eldoc-mode: t
eldoc-mode: t
show-paren-mode: t
electric-indent-mode: t
mouse-wheel-mode: t
tool-bar-mode: t
menu-bar-mode: t
file-name-shadow-mode: t
global-font-lock-mode: t
font-lock-mode: t
blink-cursor-mode: t
auto-composition-mode: t
auto-encryption-mode: t
auto-compression-mode: t
line-number-mode: t
indent-tabs-mode: t
transient-mark-mode: t
Load-path shadows:
None found.
Features:
(shadow sort mail-extr emacsbug message yank-media rmc dired
dired-loaddefs rfc822 mml mml-sec epa epg rfc6068 epg-config gnus-util
rmail rmail-loaddefs time-date mm-decode mm-bodies mm-encode mail-parse
rfc2231 mailabbrev gmm-utils mailheader sendmail rfc2047 rfc2045
ietf-drums mm-util mail-prsvr mail-utils phst skeleton derived pcase
ffap thingatpt url url-proxy url-privacy url-expand url-methods
url-history url-cookie url-domsuf url-util url-parse auth-source cl-seq
eieio eieio-core cl-macs eieio-loaddefs password-cache json map url-vars
mailcap rx gnutls puny dbus xml seq gv subr-x byte-opt bytecomp
byte-compile cconv compile text-property-search comint ansi-color ring
cl-loaddefs cl-lib iso-transl tooltip eldoc paren electric uniquify
ediff-hook vc-hooks lisp-float-type elisp-mode mwheel term/ns-win ns-win
ucs-normalize mule-util term/common-win tool-bar dnd fontset image
regexp-opt fringe tabulated-list replace newcomment text-mode lisp-mode
prog-mode register page tab-bar menu-bar rfn-eshadow isearch easymenu
timer select scroll-bar mouse jit-lock font-lock syntax font-core
term/tty-colors frame minibuffer cl-generic cham georgian utf-8-lang
misc-lang vietnamese tibetan thai tai-viet lao korean japanese eucjp-ms
cp51932 hebrew greek romanian slovak czech european ethiopic indian
cyrillic chinese composite emoji-zwj charscript charprop case-table
epa-hook jka-cmpr-hook help simple abbrev obarray cl-preloaded nadvice
button loaddefs faces cus-face macroexp files window text-properties
overlay sha1 md5 base64 format env code-pages mule custom widget keymap
hashtable-print-readable backquote threads kqueue cocoa ns lcms2
multi-tty make-network-process emacs)
Memory information:
((conses 16 70005 6853)
(symbols 48 8477 1)
(strings 32 23896 1586)
(string-bytes 1 779222)
(vectors 16 16571)
(vector-slots 8 214734 10495)
(floats 8 27 36)
(intervals 56 225 0)
(buffers 992 10))