From mboxrd@z Thu Jan 1 00:00:00 1970 From: Kyle Meyer Subject: batch failure of first org-num test Date: Mon, 07 Jan 2019 14:18:37 -0500 Message-ID: <87y37ws2cy.fsf@kyleam.com> Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Return-path: Received: from eggs.gnu.org ([209.51.188.92]:57618) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1ggaQ6-0002NG-Uc for emacs-orgmode@gnu.org; Mon, 07 Jan 2019 14:18:43 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1ggaQ6-0003hr-3h for emacs-orgmode@gnu.org; Mon, 07 Jan 2019 14:18:42 -0500 Received: from pb-smtp2.pobox.com ([64.147.108.71]:50288) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1ggaQ5-0003gK-GH for emacs-orgmode@gnu.org; Mon, 07 Jan 2019 14:18:42 -0500 Received: from pb-smtp2.pobox.com (unknown [127.0.0.1]) by pb-smtp2.pobox.com (Postfix) with ESMTP id ED86012C0FA for ; Mon, 7 Jan 2019 14:18:38 -0500 (EST) Received: from pb-smtp2.nyi.icgroup.com (unknown [127.0.0.1]) by pb-smtp2.pobox.com (Postfix) with ESMTP id E3B6512C0F9 for ; Mon, 7 Jan 2019 14:18:38 -0500 (EST) Received: from localhost (unknown [192.54.222.12]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by pb-smtp2.pobox.com (Postfix) with ESMTPSA id 620A212C0F8 for ; Mon, 7 Jan 2019 14:18:38 -0500 (EST) List-Id: "General discussions about Org-mode." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org@gnu.org Sender: "Emacs-orgmode" To: emacs-orgmode@gnu.org Hello, When I run the tests on master in batch (specifically =E2=80=98make test=E2= =80=99), test-org-num/format-function fails (backtrace at end of message). That test doesn't fail if I run it interactively. Looking at test-org-num.el, I see that the first test, test-org-num/face, is commented with the explanation =E2=80=9CFIXME: this t= est fails in batch mode=E2=80=9D. So it seems that commenting out that test ju= st pushes the failure down the line. And indeed if I comment out test-org-num/format-function, the next test fails. I don=E2=80=99t have an understanding of the underlying issue, but if I add =E2=80=98(require 'org-num)=E2=80=99 to test-org-num.el, all tests pass for= me with =E2=80=98make test=E2=80=99. --8<---------------cut here---------------start------------->8--- Test test-org-num/format-function backtrace: signal(ert-test-failed (((should (equal '("foo" "foo") (org-test-wit ert-fail(((should (equal '("foo" "foo") (org-test-with-temp-text "*=20 (if (unwind-protect (setq value-8786 (apply fn-8784 args-8785)) (set (let (form-description-8788) (if (unwind-protect (setq value-8786 (a (let ((value-8786 'ert-form-evaluation-aborted-8787)) (let (form-des (let* ((fn-8784 (function equal)) (args-8785 (condition-case err (le (closure (t) nil (let* ((fn-8784 (function equal)) (args-8785 (condi ert--run-test-internal(#s(ert--test-execution-info :test #s(ert-test ert-run-test(#s(ert-test :name test-org-num/format-function :documen ert-run-or-rerun-test(#s(ert--stats :selector "\\(org\\|ob\\)" :test ert-run-tests("\\(org\\|ob\\)" #f(compiled-function (event-type &res ert-run-tests-batch("\\(org\\|ob\\)") ert-run-tests-batch-and-exit("\\(org\\|ob\\)") (let ((org-id-track-globally t) (org-test-selector (if org-test-sele org-test-run-batch-tests("\\(org\\|ob\\)") eval((org-test-run-batch-tests org-test-select-re)) command-line-1(("--eval" "(setq vc-handled-backends nil org-startup- command-line() normal-top-level() Test test-org-num/format-function condition: (ert-test-failed ((should (equal '... (org-test-with-temp-text "* H1 ** H2" ... ...))) :form (equal ("foo" "foo") (#("1.1 " 0 4 ...) #("1 " 0 2 ...))) :value nil :explanation (list-elt 0 (arrays-of-different-length 3 4 "foo" #("1.1 " 0 4 ...) first-mismatch-at 0)))) --8<---------------cut here---------------end--------------->8---