From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!not-for-mail From: phillip.lord@russet.org.uk (Phillip Lord) Newsgroups: gmane.emacs.bugs Subject: bug#22471: ert batch should print compile parsable error messages Date: Wed, 27 Jan 2016 21:53:58 +0000 Message-ID: <87twlyd6yx.fsf@russet.org.uk> References: <87bn878jsv.fsf@russet.org.uk> <83pownyplf.fsf@gnu.org> NNTP-Posting-Host: plane.gmane.org Mime-Version: 1.0 Content-Type: text/plain X-Trace: ger.gmane.org 1453942836 16907 80.91.229.3 (28 Jan 2016 01:00:36 GMT) X-Complaints-To: usenet@ger.gmane.org NNTP-Posting-Date: Thu, 28 Jan 2016 01:00:36 +0000 (UTC) Cc: 22471@debbugs.gnu.org To: Eli Zaretskii Original-X-From: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane.org@gnu.org Wed Jan 27 22:55:19 2016 Return-path: Envelope-to: geb-bug-gnu-emacs@m.gmane.org Original-Received: from lists.gnu.org ([208.118.235.17]) by plane.gmane.org with esmtp (Exim 4.69) (envelope-from ) id 1aOY3S-0003zv-PS for geb-bug-gnu-emacs@m.gmane.org; Wed, 27 Jan 2016 22:55:10 +0100 Original-Received: from localhost ([::1]:52752 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1aOY3S-0001cH-7m for geb-bug-gnu-emacs@m.gmane.org; Wed, 27 Jan 2016 16:55:10 -0500 Original-Received: from eggs.gnu.org ([2001:4830:134:3::10]:59582) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1aOY3N-0001bu-RD for bug-gnu-emacs@gnu.org; Wed, 27 Jan 2016 16:55:06 -0500 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1aOY3K-000138-CI for bug-gnu-emacs@gnu.org; Wed, 27 Jan 2016 16:55:05 -0500 Original-Received: from debbugs.gnu.org ([208.118.235.43]:50767) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1aOY3K-00012v-9P for bug-gnu-emacs@gnu.org; Wed, 27 Jan 2016 16:55:02 -0500 Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84) (envelope-from ) id 1aOY3K-0006Kw-4X for bug-gnu-emacs@gnu.org; Wed, 27 Jan 2016 16:55:02 -0500 X-Loop: help-debbugs@gnu.org Resent-From: phillip.lord@russet.org.uk (Phillip Lord) Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Wed, 27 Jan 2016 21:55:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 22471 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: Original-Received: via spool by 22471-submit@debbugs.gnu.org id=B22471.145393164324265 (code B ref 22471); Wed, 27 Jan 2016 21:55:02 +0000 Original-Received: (at 22471) by debbugs.gnu.org; 27 Jan 2016 21:54:03 +0000 Original-Received: from localhost ([127.0.0.1]:38987 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84) (envelope-from ) id 1aOY2N-0006JI-0Z for submit@debbugs.gnu.org; Wed, 27 Jan 2016 16:54:03 -0500 Original-Received: from cheviot12.ncl.ac.uk ([128.240.234.12]:35342) by debbugs.gnu.org with esmtp (Exim 4.84) (envelope-from ) id 1aOY2K-0006It-KT for 22471@debbugs.gnu.org; Wed, 27 Jan 2016 16:54:01 -0500 Original-Received: from smtpauth-vm.ncl.ac.uk ([10.8.233.129] helo=smtpauth.ncl.ac.uk) by cheviot12.ncl.ac.uk with esmtp (Exim 4.63) (envelope-from ) id 1aOY2J-0006bp-BV; Wed, 27 Jan 2016 21:53:59 +0000 Original-Received: from cpc1-benw10-2-0-cust373.gate.cable.virginm.net ([77.98.219.118] helo=localhost) by smtpauth.ncl.ac.uk with esmtpsa (TLSv1:AES128-SHA:128) (Exim 4.63) (envelope-from ) id 1aOY2J-0000GH-DV; Wed, 27 Jan 2016 21:53:59 +0000 In-Reply-To: <83pownyplf.fsf@gnu.org> (Eli Zaretskii's message of "Wed, 27 Jan 2016 18:06:04 +0200") User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.5 (gnu/linux) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 208.118.235.43 X-BeenThere: bug-gnu-emacs@gnu.org List-Id: "Bug reports for GNU Emacs, the Swiss army knife of text editors" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane.org@gnu.org Original-Sender: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane.org@gnu.org Xref: news.gmane.org gmane.emacs.bugs:112039 Eli Zaretskii writes: >> From: phillip.lord@russet.org.uk (Phillip Lord) >> Date: Wed, 27 Jan 2016 09:15:44 +0000 >> >> >> Currently, when running in batch, ert prints out messages like so: >> >> >> Running 24 tests (2016-01-27 09:05:17+0000) >> passed 1/24 buffer-string= >> passed 2/24 buffer= >> ... >> passed 22/24 sisyphus-test-with-find-file >> passed 23/24 to-string >> passed 24/24 with-temp-buffers >> >> Ran 24 tests, 23 results as expected, 1 unexpected (2016-01-27 09:05:18+0000) >> >> 1 unexpected results: >> FAILED crash-out >> >> It would be nice to add some compilation-mode parsable data to this. So, >> something like >> >> >> passed 1/24 buffer-string= (in ./test.sisyphus-test.el:22:) > > FWIW, I have never seen a test suite that displayed in > compilation-mode compatible format. If we do that (and I'm > necessarily opposed to that), we'd be the odd one out, I think. There's a couple in the compilation mode regexp -- cucumber, ruby and perl test harnesses and so forth. I put a quick attempt at this up on feature/parsable-ert-output. passed 22/24 sisyphus-test-with-find-file at test/sisyphus-test.el line 277. passed 23/24 to-string at test/sisyphus-test.el line 96. passed 24/24 with-temp-buffers at test/sisyphus-test.el line 232. Works, but makes for rather a cluttered output. Thoughts welcome. Phil