From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Philipp Newsgroups: gmane.emacs.bugs Subject: bug#52429: 29.0.50; Flymake tests failing on macOS Date: Sat, 11 Dec 2021 14:36:06 +0100 Message-ID: Mime-Version: 1.0 Content-Type: text/plain Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="10677"; mail-complaints-to="usenet@ciao.gmane.io" To: 52429@debbugs.gnu.org Original-X-From: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Sat Dec 11 14:37:13 2021 Return-path: Envelope-to: geb-bug-gnu-emacs@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1mw2Yr-0002aK-0Q for geb-bug-gnu-emacs@m.gmane-mx.org; Sat, 11 Dec 2021 14:37:13 +0100 Original-Received: from localhost ([::1]:45260 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1mw2Yo-0005ri-SB for geb-bug-gnu-emacs@m.gmane-mx.org; Sat, 11 Dec 2021 08:37:10 -0500 Original-Received: from eggs.gnu.org ([209.51.188.92]:42926) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mw2Yg-0005q5-Sw for bug-gnu-emacs@gnu.org; Sat, 11 Dec 2021 08:37:02 -0500 Original-Received: from debbugs.gnu.org ([209.51.188.43]:37234) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1mw2Yg-0001PZ-Kl for bug-gnu-emacs@gnu.org; Sat, 11 Dec 2021 08:37:02 -0500 Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1mw2Yg-0005Fi-E1 for bug-gnu-emacs@gnu.org; Sat, 11 Dec 2021 08:37:02 -0500 X-Loop: help-debbugs@gnu.org Resent-From: Philipp Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Sat, 11 Dec 2021 13:37:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: report 52429 X-GNU-PR-Package: emacs X-Debbugs-Original-To: bug-gnu-emacs@gnu.org Original-Received: via spool by submit@debbugs.gnu.org id=B.163922977720135 (code B ref -1); Sat, 11 Dec 2021 13:37:02 +0000 Original-Received: (at submit) by debbugs.gnu.org; 11 Dec 2021 13:36:17 +0000 Original-Received: from localhost ([127.0.0.1]:48780 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1mw2Xw-0005Eg-9a for submit@debbugs.gnu.org; Sat, 11 Dec 2021 08:36:16 -0500 Original-Received: from lists.gnu.org ([209.51.188.17]:46364) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1mw2Xu-0005EY-Cp for submit@debbugs.gnu.org; Sat, 11 Dec 2021 08:36:14 -0500 Original-Received: from eggs.gnu.org ([209.51.188.92]:42700) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mw2Xs-0005N8-QH for bug-gnu-emacs@gnu.org; Sat, 11 Dec 2021 08:36:14 -0500 Original-Received: from [2a00:1450:4864:20::436] (port=38617 helo=mail-wr1-x436.google.com) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1mw2Xq-0001J5-W9 for bug-gnu-emacs@gnu.org; Sat, 11 Dec 2021 08:36:12 -0500 Original-Received: by mail-wr1-x436.google.com with SMTP id q3so19413823wru.5 for ; Sat, 11 Dec 2021 05:36:10 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=from:to:subject:date:message-id:mime-version; bh=nt6AROIyZTk/ggd2mj/Ac1v8s/I/n7CVO66s5kv06NU=; b=QCdAcT6KIzeis2Tns8ikkSyn0gRbKEKl00/yOJFIzhXWtWtxRmmzhLXZ0ifMPsRYQr WDeCG8m9CDP/brPsjTrIOrAQn1bq39nmEiWW5uwJFonJLKE25u1uy3TPRt0ZGiznbnM3 /o7NKhpXLSzTIAdY2KbJMzlV9xXz7Pwd5WUzX9ukh1cXSba6RQUw9ePJVBTreewbSaPI Wb4A5f4VQ0oAU3A7g3bmqoBz74sllZ/vm7abg3OoANk4530QQ3mlCbwOux4zH+JCd/RQ ojDTDuxqpZFJIzJv9wIfHcXWp5D1jSQ4n6HXSnqNlWQ9HIwPNQJ6I1biJvS2jQ3uxXES yqGA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:from:to:subject:date:message-id:mime-version; bh=nt6AROIyZTk/ggd2mj/Ac1v8s/I/n7CVO66s5kv06NU=; b=Dnzttyttj+GjhWlW8iyqtIOfdIzEPJaEs7lVv40JJEa+kx7FEKVH5e/WIpz3aiIHsn 8b2E7Y59RQuboJcPQR8n/HA4Tbn6ljL4WbOu8rzqaFYme88el76ioZlKnq+o24W3Xhou tejxk1KuK1xBPLioB9r94MzL9oEN9YXa17pVswkq24zhL39BlkHakUkLOEWQkqFIOSUr 1dVno/7Ao3GYo8WynYMQKqOZCqbwKa4JH0cxGTqO/RFuaQ35VjS7uYhOL3RWJlh8rNcF xJK8Fli6kkM1LcdPdPXSKJjktnNZSxs3aaJckzO+XvGbyqCTXtoqrESTHtiNAIIo5fdk /yJw== X-Gm-Message-State: AOAM530roJuxcxADpbgRgJDlZIEQHdLkO/ZlFKUiqdvUHbBvmcGJZMbk Jr3WCHsGGHzaLmpakfc34cvwUWMJ1xs= X-Google-Smtp-Source: ABdhPJyKCQmszjJmtFru/5MjjFIuM5VeFxb1e1oFX9kA7sUQVqHhLwXshfqzGury8hxketbSKVhI+w== X-Received: by 2002:adf:e702:: with SMTP id c2mr20585247wrm.586.1639229768160; Sat, 11 Dec 2021 05:36:08 -0800 (PST) Original-Received: from Philipps-MacBook-Pro.local ([2a02:2455:2a5:ba00:5d9:6746:6ba6:2428]) by smtp.gmail.com with ESMTPSA id m1sm1535873wme.39.2021.12.11.05.36.07 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 11 Dec 2021 05:36:07 -0800 (PST) X-Host-Lookup-Failed: Reverse DNS lookup failed for 2a00:1450:4864:20::436 (failed) Received-SPF: pass client-ip=2a00:1450:4864:20::436; envelope-from=p.stephani2@gmail.com; helo=mail-wr1-x436.google.com X-Spam_score_int: -10 X-Spam_score: -1.1 X-Spam_bar: - X-Spam_report: (-1.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RDNS_NONE=0.793, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=no autolearn_force=no X-Spam_action: no action X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-gnu-emacs@gnu.org List-Id: "Bug reports for GNU Emacs, the Swiss army knife of text editors" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Original-Sender: "bug-gnu-emacs" Xref: news.gmane.io gmane.emacs.bugs:222118 Archived-At: On my macOS Monterey machine, the Flymake tests partially fail, both on the emacs-28 and the master branch. Log follows: Running 9 tests (2021-12-11 14:25:11+0100, selector `(not (or (tag :expensive-test) (tag :unstable) (tag :nativecomp)))') Test different-diagnostic-types backtrace: signal(ert-test-failed (((should (eq 'flymake-error (face-at-point)) ert-fail(((should (eq 'flymake-error (face-at-point))) :form (eq fly #f(compiled-function () #)() flymake-tests--call-with-fixture(#f(compiled-function () #)() ert--run-test-internal(#s(ert--test-execution-info :test #s(ert-test ert-run-test(#s(ert-test :name different-diagnostic-types :documenta ert-run-or-rerun-test(#s(ert--stats :selector (not (or ... ... ...)) ert-run-tests((not (or (tag :expensive-test) (tag :unstable) (tag :n ert-run-tests-batch((not (or (tag :expensive-test) (tag :unstable) ( ert-run-tests-batch-and-exit((not (or (tag :expensive-test) (tag :un eval((ert-run-tests-batch-and-exit '(not (or (tag :expensive-test) ( command-line-1(("-L" ":." "-l" "ert" "-l" "lisp/progmodes/flymake-te command-line() normal-top-level() Test different-diagnostic-types condition: (ert-test-failed ((should (eq 'flymake-error (face-at-point))) :form (eq flymake-error flymake-warning) :value nil)) FAILED 1/9 different-diagnostic-types (1.273652 sec) passed 2/9 dummy-backends (1.009144 sec) passed 3/9 eob-region-and-trailing-newline (0.000464 sec) Test included-c-header-files backtrace: signal(ert-test-failed (((should (eq 'flymake-error (face-at-point)) ert-fail(((should (eq 'flymake-error (face-at-point))) :form (eq fly #f(compiled-function () #)() flymake-tests--call-with-fixture(#f(compiled-function () #)() ert--run-test-internal(#s(ert--test-execution-info :test #s(ert-test ert-run-test(#s(ert-test :name included-c-header-files :documentatio ert-run-or-rerun-test(#s(ert--stats :selector ... :tests ... :test-m ert-run-tests((not (or (tag :expensive-test) (tag :unstable) (tag :n ert-run-tests-batch((not (or (tag :expensive-test) (tag :unstable) ( ert-run-tests-batch-and-exit((not (or (tag :expensive-test) (tag :un eval((ert-run-tests-batch-and-exit '(not (or (tag :expensive-test) ( command-line-1(("-L" ":." "-l" "ert" "-l" "lisp/progmodes/flymake-te command-line() normal-top-level() Test included-c-header-files condition: (ert-test-failed ((should (eq 'flymake-error (face-at-point))) :form (eq flymake-error flymake-warning) :value nil)) FAILED 4/9 included-c-header-files (1.091255 sec) passed 5/9 perl-backend (1.032770 sec) passed 6/9 recurrent-backend (1.031638 sec) passed 7/9 ruby-backend (1.174518 sec) passed 8/9 warning-predicate-function-gcc (1.045177 sec) passed 9/9 warning-predicate-rx-gcc (1.089723 sec) Ran 9 tests, 7 results as expected, 2 unexpected (2021-12-11 14:25:20+0100, 9.383207 sec) 2 unexpected results: FAILED different-diagnostic-types FAILED included-c-header-files I haven't dug deeper, but this looks like the compiler returns a warning where an error is expected. Typically such tests should mock the compiler using canned output checked into the repository. In GNU Emacs 29.0.50 (build 25, aarch64-apple-darwin21.1.0, NS appkit-2113.00 Version 12.0.1 (Build 21A559)) of 2021-12-11 Repository revision: 8c50016b100ec2c548ec90131e0f5fb5f4ebb5c1 Repository branch: master Windowing system distributor 'Apple', version 10.3.2113 System Description: macOS 12.0.1 Configured using: 'configure --with-modules --without-xml2 --without-pop --with-mailutils --enable-gcc-warnings=warn-only --enable-checking=all --enable-check-lisp-object-type '--prefix=/tmp/\7'' Configured features: ACL GNUTLS JSON LCMS2 MODULES NOTIFY KQUEUE NS PDUMPER PNG SQLITE3 THREADS TOOLKIT_SCROLL_BARS ZLIB Important settings: value of $LANG: de_DE.UTF-8 locale-coding-system: utf-8-unix Major mode: Lisp Interaction Minor modes in effect: tooltip-mode: t global-eldoc-mode: t eldoc-mode: t show-paren-mode: t electric-indent-mode: t mouse-wheel-mode: t tool-bar-mode: t menu-bar-mode: t file-name-shadow-mode: t global-font-lock-mode: t font-lock-mode: t blink-cursor-mode: t auto-composition-mode: t auto-encryption-mode: t auto-compression-mode: t line-number-mode: t indent-tabs-mode: t transient-mark-mode: t Load-path shadows: None found. Features: (shadow sort mail-extr emacsbug message yank-media rmc dired dired-loaddefs rfc822 mml mml-sec epa epg rfc6068 epg-config gnus-util rmail rmail-loaddefs time-date mm-decode mm-bodies mm-encode mail-parse rfc2231 mailabbrev gmm-utils mailheader sendmail rfc2047 rfc2045 ietf-drums mm-util mail-prsvr mail-utils phst skeleton derived pcase ffap thingatpt url url-proxy url-privacy url-expand url-methods url-history url-cookie url-domsuf url-util url-parse auth-source cl-seq eieio eieio-core cl-macs eieio-loaddefs password-cache json map url-vars mailcap rx gnutls puny dbus xml seq gv subr-x byte-opt bytecomp byte-compile cconv compile text-property-search comint ansi-color ring cl-loaddefs cl-lib iso-transl tooltip eldoc paren electric uniquify ediff-hook vc-hooks lisp-float-type elisp-mode mwheel term/ns-win ns-win ucs-normalize mule-util term/common-win tool-bar dnd fontset image regexp-opt fringe tabulated-list replace newcomment text-mode lisp-mode prog-mode register page tab-bar menu-bar rfn-eshadow isearch easymenu timer select scroll-bar mouse jit-lock font-lock syntax font-core term/tty-colors frame minibuffer cl-generic cham georgian utf-8-lang misc-lang vietnamese tibetan thai tai-viet lao korean japanese eucjp-ms cp51932 hebrew greek romanian slovak czech european ethiopic indian cyrillic chinese composite emoji-zwj charscript charprop case-table epa-hook jka-cmpr-hook help simple abbrev obarray cl-preloaded nadvice button loaddefs faces cus-face macroexp files window text-properties overlay sha1 md5 base64 format env code-pages mule custom widget keymap hashtable-print-readable backquote threads kqueue cocoa ns lcms2 multi-tty make-network-process emacs) Memory information: ((conses 16 70005 6853) (symbols 48 8477 1) (strings 32 23896 1586) (string-bytes 1 779222) (vectors 16 16571) (vector-slots 8 214734 10495) (floats 8 27 36) (intervals 56 225 0) (buffers 992 10))