From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!not-for-mail From: phillip.lord@russet.org.uk (Phillip Lord) Newsgroups: gmane.emacs.bugs Subject: bug#22471: ert batch should print compile parsable error messages Date: Wed, 27 Jan 2016 09:15:44 +0000 Message-ID: <87bn878jsv.fsf@russet.org.uk> NNTP-Posting-Host: plane.gmane.org Mime-Version: 1.0 Content-Type: text/plain X-Trace: ger.gmane.org 1453886245 4447 80.91.229.3 (27 Jan 2016 09:17:25 GMT) X-Complaints-To: usenet@ger.gmane.org NNTP-Posting-Date: Wed, 27 Jan 2016 09:17:25 +0000 (UTC) To: 22471@debbugs.gnu.org Original-X-From: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane.org@gnu.org Wed Jan 27 10:17:11 2016 Return-path: Envelope-to: geb-bug-gnu-emacs@m.gmane.org Original-Received: from lists.gnu.org ([208.118.235.17]) by plane.gmane.org with esmtp (Exim 4.69) (envelope-from ) id 1aOMDu-0003f8-Ku for geb-bug-gnu-emacs@m.gmane.org; Wed, 27 Jan 2016 10:17:10 +0100 Original-Received: from localhost ([::1]:48679 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1aOMDu-0001a4-2d for geb-bug-gnu-emacs@m.gmane.org; Wed, 27 Jan 2016 04:17:10 -0500 Original-Received: from eggs.gnu.org ([2001:4830:134:3::10]:46350) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1aOMDq-0001ZQ-1R for bug-gnu-emacs@gnu.org; Wed, 27 Jan 2016 04:17:06 -0500 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1aOMDm-0001Lj-RR for bug-gnu-emacs@gnu.org; Wed, 27 Jan 2016 04:17:05 -0500 Original-Received: from debbugs.gnu.org ([208.118.235.43]:49846) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1aOMDm-0001LM-OH for bug-gnu-emacs@gnu.org; Wed, 27 Jan 2016 04:17:02 -0500 Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84) (envelope-from ) id 1aOMDm-0001d9-I3 for bug-gnu-emacs@gnu.org; Wed, 27 Jan 2016 04:17:02 -0500 X-Loop: help-debbugs@gnu.org Resent-From: phillip.lord@russet.org.uk (Phillip Lord) Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Wed, 27 Jan 2016 09:17:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: report 22471 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: X-Debbugs-Original-To: bug-gnu-emacs@gnu.org Original-Received: via spool by submit@debbugs.gnu.org id=B.14538861616173 (code B ref -1); Wed, 27 Jan 2016 09:17:02 +0000 Original-Received: (at submit) by debbugs.gnu.org; 27 Jan 2016 09:16:01 +0000 Original-Received: from localhost ([127.0.0.1]:38066 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84) (envelope-from ) id 1aOMCn-0001bR-A1 for submit@debbugs.gnu.org; Wed, 27 Jan 2016 04:16:01 -0500 Original-Received: from eggs.gnu.org ([208.118.235.92]:54897) by debbugs.gnu.org with esmtp (Exim 4.84) (envelope-from ) id 1aOMCl-0001b8-Kb for submit@debbugs.gnu.org; Wed, 27 Jan 2016 04:16:00 -0500 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1aOMCf-0000zd-Rd for submit@debbugs.gnu.org; Wed, 27 Jan 2016 04:15:54 -0500 Original-Received: from lists.gnu.org ([2001:4830:134:3::11]:36293) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1aOMCf-0000zZ-P1 for submit@debbugs.gnu.org; Wed, 27 Jan 2016 04:15:53 -0500 Original-Received: from eggs.gnu.org ([2001:4830:134:3::10]:45867) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1aOMCe-0001M2-UC for bug-gnu-emacs@gnu.org; Wed, 27 Jan 2016 04:15:53 -0500 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1aOMCZ-0000yr-G6 for bug-gnu-emacs@gnu.org; Wed, 27 Jan 2016 04:15:52 -0500 Original-Received: from cheviot12.ncl.ac.uk ([128.240.234.12]:38517) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1aOMCZ-0000yl-AL for bug-gnu-emacs@gnu.org; Wed, 27 Jan 2016 04:15:47 -0500 Original-Received: from smtpauth-vm.ncl.ac.uk ([10.8.233.129] helo=smtpauth.ncl.ac.uk) by cheviot12.ncl.ac.uk with esmtp (Exim 4.63) (envelope-from ) id 1aOMCX-0005S5-BN for bug-gnu-emacs@gnu.org; Wed, 27 Jan 2016 09:15:45 +0000 Original-Received: from cpc1-benw10-2-0-cust373.gate.cable.virginm.net ([77.98.219.118] helo=localhost) by smtpauth.ncl.ac.uk with esmtpsa (TLSv1:AES128-SHA:128) (Exim 4.63) (envelope-from ) id 1aOMCX-00036x-CK for bug-gnu-emacs@gnu.org; Wed, 27 Jan 2016 09:15:45 +0000 User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.5 (gnu/linux) X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 208.118.235.43 X-BeenThere: bug-gnu-emacs@gnu.org List-Id: "Bug reports for GNU Emacs, the Swiss army knife of text editors" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane.org@gnu.org Original-Sender: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane.org@gnu.org Xref: news.gmane.org gmane.emacs.bugs:112024 Archived-At: Currently, when running in batch, ert prints out messages like so: Running 24 tests (2016-01-27 09:05:17+0000) passed 1/24 buffer-string= passed 2/24 buffer= ... passed 22/24 sisyphus-test-with-find-file passed 23/24 to-string passed 24/24 with-temp-buffers Ran 24 tests, 23 results as expected, 1 unexpected (2016-01-27 09:05:18+0000) 1 unexpected results: FAILED crash-out It would be nice to add some compilation-mode parsable data to this. So, something like passed 1/24 buffer-string= (in ./test.sisyphus-test.el:22:) It would also be nice to add colourisation: red and green for passed and failed. In the idea world, these could be added as ansi colour codes to the batch output of ERT. They should work on the command line then also. More of an RFE than a bug, but it is odd that compilation mode works with lots and lots of test frameworks, but not Emacs' Phil