all messages for Emacs-related lists mirrored at yhetil.org
 help / color / mirror / code / Atom feed
From: Jorgen Schaefer <contact@jorgenschaefer.de>
To: 19657@debbugs.gnu.org
Subject: bug#19657: 25.0.50; Test failures in Emacs master, can't figure out what I'm doing wrong
Date: Thu, 22 Jan 2015 20:00:35 +0100	[thread overview]
Message-ID: <87sif24p4c.fsf@loki.jorgenschaefer.de> (raw)

Hi.
I can't get the Emacs test suite to run properly, which makes it
difficult for me to write tests for it ... I'm open for suggestions on
what I am doing wrong! :-)

Working on a clean checkout of 3e359626:

$ ./autogen.sh && ./configure --without-x && make

Configured for `x86_64-unknown-linux-gnu'.

  Where should the build process find the source code?    .
  What compiler should emacs be built with?               gcc -std=gnu99 -g3 -O2
  Should Emacs use the GNU version of malloc?             yes
  (Using Doug Lea's new malloc from the GNU C Library.)
  Should Emacs use a relocating allocator for buffers?    no
  Should Emacs use mmap(2) for buffer allocation?         no
  What window system should Emacs use?                    none
  What toolkit should Emacs use?                          none
  Where do we find X Windows header files?                NONE
  Where do we find X Windows libraries?                   NONE
  Does Emacs use -lXaw3d?                                 no
  Does Emacs use -lXpm?                                   no
  Does Emacs use -ljpeg?                                  no
  Does Emacs use -ltiff?                                  no
  Does Emacs use a gif library?                           no
  Does Emacs use a png library?                           no
  Does Emacs use -lrsvg-2?                                no
  Does Emacs use imagemagick?                             no
  Does Emacs support sound?                               yes
  Does Emacs use -lgpm?                                   no
  Does Emacs use -ldbus?                                  no
  Does Emacs use -lgconf?                                 no
  Does Emacs use GSettings?                               no
  Does Emacs use a file notification library?             yes -lglibc (inotify)
  Does Emacs use access control lists?                    no
  Does Emacs use -lselinux?                               no
  Does Emacs use -lgnutls?                                no
  Does Emacs use -lxml2?                                  yes
  Does Emacs use -lfreetype?                              no
  Does Emacs use -lm17n-flt?                              no
  Does Emacs use -lotf?                                   no
  Does Emacs use -lxft?                                   no
  Does Emacs directly use zlib?                           yes
  Does Emacs use toolkit scroll bars?                     no

$ make check

Ran 1211 tests, 1189 results as expected, 10 unexpected, 12 skipped
2 files contained unexpected results:
  regexp-tests.log
  package-test.log

$ cat regexp-tests.log
Running 1 tests (2015-01-22 19:30:42+0100)
Test regexp-test-regexp-opt backtrace:
  ert--run-test-internal([cl-struct-ert--test-execution-info [cl-struc
  ert-run-test([cl-struct-ert-test regexp-test-regexp-opt "Test the `c
  ert-run-or-rerun-test([cl-struct-ert--stats t [[cl-struct-ert-test r
  ert-run-tests(t #[385 "...
  ert-run-tests-batch(nil)
  ert-run-tests-batch-and-exit()
  command-line-1(("-L" ":." "-l" "ert" "-l" "regexp-tests.elc" "-f" "e
  command-line()
  normal-top-level()
Test regexp-test-regexp-opt condition:
    (void-function regexp-opt-charset)
   FAILED  1/1  regexp-test-regexp-opt

Ran 1 tests, 0 results as expected, 1 unexpected (2015-01-22 19:30:42+0100)

1 unexpected results:
   FAILED  regexp-test-regexp-opt

$ cat package-test.log
Running 15 tests (2015-01-22 19:30:38+0100)
Parsing tar file...
Parsing tar file...done
   passed   1/15  package-test-desc-from-buffer
Importing package-keyring.gpg...
Importing package-keyring.gpg...done
Type C-x 1 to delete the help window, C-M-v to scroll help.
   passed   2/15  package-test-describe-non-installed-multi-file-package
Importing package-keyring.gpg...
Importing package-keyring.gpg...done
Type C-x 1 to delete the help window, C-M-v to scroll help.
   passed   3/15  package-test-describe-non-installed-package
Type C-x 1 to delete the help window, C-M-v to scroll help.
Importing package-keyring.gpg...
Importing package-keyring.gpg...done
Making backup-inhibited local to simple-single-autoloads.el while let-bound!
Making version-control local to  *autoload-file* while let-bound!
Test package-test-describe-package backtrace:
  autoload-find-destination("/home/forcer/tmp/pkg-test-user-dir-28222y
  autoload--setup-output(t nil "/home/forcer/tmp/pkg-test-user-dir-282
  autoload-generate-file-autoloads("../../../simple-single-1.3/simple-
  update-directory-autoloads("/home/forcer/tmp/pkg-test-user-dir-28222
  package-generate-autoloads(simple-single "/home/forcer/tmp/pkg-test-
  package--make-autoloads-and-stuff([cl-struct-package-desc simple-sin
  package-unpack([cl-struct-package-desc simple-single (1 3) "A single
  package-install-from-archive([cl-struct-package-desc simple-single (
  mapc(package-install-from-archive ([cl-struct-package-desc simple-si
  package-download-transaction(([cl-struct-package-desc simple-single
  package-install(simple-single)
  #[nil "...
  ert--run-test-internal([cl-struct-ert--test-execution-info [cl-struc
  ert-run-test([cl-struct-ert-test package-test-describe-package "Test
  ert-run-or-rerun-test([cl-struct-ert--stats t [[cl-struct-ert-test p
  ert-run-tests(t #[385 "...
  ert-run-tests-batch(nil)
  ert-run-tests-batch-and-exit()
  command-line-1(("-L" ":." "-l" "ert" "-l" "package-test.elc" "-f" "e
  command-line()
  normal-top-level()
Test package-test-describe-package condition:
    (error "Autoloads file /home/forcer/tmp/pkg-test-user-dir-28222yTo/tmp/pkg-test-user-dir-28222yTo/simple-single-1.3/simple-single-autoloads.el lacks boilerplate")
   FAILED   4/15  package-test-describe-package
Importing package-keyring.gpg...
Importing package-keyring.gpg...done
Test package-test-install-dependency backtrace:
  autoload-find-destination("/home/forcer/tmp/pkg-test-user-dir-28222_
  autoload--setup-output(t nil "/home/forcer/tmp/pkg-test-user-dir-282
  autoload-generate-file-autoloads("../../../simple-single-1.3/simple-
  update-directory-autoloads("/home/forcer/tmp/pkg-test-user-dir-28222
  package-generate-autoloads(simple-single "/home/forcer/tmp/pkg-test-
  package--make-autoloads-and-stuff([cl-struct-package-desc simple-sin
  package-unpack([cl-struct-package-desc simple-single (1 3) "A single
  package-install-from-archive([cl-struct-package-desc simple-single (
  mapc(package-install-from-archive ([cl-struct-package-desc simple-si
  package-download-transaction(([cl-struct-package-desc simple-single
  package-install(simple-depend)
  #[nil "...
  ert--run-test-internal([cl-struct-ert--test-execution-info [cl-struc
  ert-run-test([cl-struct-ert-test package-test-install-dependency "In
  ert-run-or-rerun-test([cl-struct-ert--stats t [[cl-struct-ert-test p
  ert-run-tests(t #[385 "...
  ert-run-tests-batch(nil)
  ert-run-tests-batch-and-exit()
  command-line-1(("-L" ":." "-l" "ert" "-l" "package-test.elc" "-f" "e
  command-line()
  normal-top-level()
Test package-test-install-dependency condition:
    (error "Autoloads file /home/forcer/tmp/pkg-test-user-dir-28222_du/tmp/pkg-test-user-dir-28222_du/simple-single-1.3/simple-single-autoloads.el lacks boilerplate")
   FAILED   5/15  package-test-install-dependency
Importing package-keyring.gpg...
Importing package-keyring.gpg...done
Parsing tar file...
Parsing tar file...done
Extracting multi-file-0.2.3/
Extracting multi-file-0.2.3/multi-file.el
Extracting multi-file-0.2.3/multi-file-sub.el
Extracting multi-file-0.2.3/multi-file.info
Extracting multi-file-0.2.3/README
Extracting multi-file-0.2.3/dir
Extracting multi-file-0.2.3/multi-file-pkg.el
Extracting multi-file-0.2.3/multi-file.texi
Test package-test-install-multifile backtrace:
  autoload-find-destination("/home/forcer/tmp/pkg-test-user-dir-28222M
  autoload--setup-output(t nil "/home/forcer/tmp/pkg-test-user-dir-282
  autoload-generate-file-autoloads("../../../multi-file-0.2.3/multi-fi
  update-directory-autoloads("/home/forcer/tmp/pkg-test-user-dir-28222
  package-generate-autoloads(multi-file "/home/forcer/tmp/pkg-test-use
  package--make-autoloads-and-stuff([cl-struct-package-desc multi-file
  package-unpack([cl-struct-package-desc multi-file (0 2 3) "Example o
  package-install-from-archive([cl-struct-package-desc multi-file (0 2
  mapc(package-install-from-archive ([cl-struct-package-desc multi-fil
  package-download-transaction(([cl-struct-package-desc multi-file (0
  package-install(multi-file)
  mapc(package-install (multi-file))
  #[nil "...
  ert--run-test-internal([cl-struct-ert--test-execution-info [cl-struc
  ert-run-test([cl-struct-ert-test package-test-install-multifile "Che
  ert-run-or-rerun-test([cl-struct-ert--stats t [[cl-struct-ert-test p
  ert-run-tests(t #[385 "...
  ert-run-tests-batch(nil)
  ert-run-tests-batch-and-exit()
  command-line-1(("-L" ":." "-l" "ert" "-l" "package-test.elc" "-f" "e
  command-line()
  normal-top-level()
Test package-test-install-multifile condition:
    (error "Autoloads file /home/forcer/tmp/pkg-test-user-dir-28222Mo0/tmp/pkg-test-user-dir-28222Mo0/multi-file-0.2.3/multi-file-autoloads.el lacks boilerplate")
   FAILED   6/15  package-test-install-multifile
Test package-test-install-single backtrace:
  autoload-find-destination("/home/forcer/tmp/pkg-test-user-dir-28222-
  autoload--setup-output(t nil "/home/forcer/tmp/pkg-test-user-dir-282
  autoload-generate-file-autoloads("../../../simple-single-1.3/simple-
  update-directory-autoloads("/home/forcer/tmp/pkg-test-user-dir-28222
  package-generate-autoloads(simple-single "/home/forcer/tmp/pkg-test-
  package--make-autoloads-and-stuff([cl-struct-package-desc simple-sin
  package-unpack([cl-struct-package-desc simple-single (1 3) "A single
  package-install-from-buffer()
  apply(package-install-from-buffer nil)
  #[nil "...
  ert--run-test-internal([cl-struct-ert--test-execution-info [cl-struc
  ert-run-test([cl-struct-ert-test package-test-install-single "Instal
  ert-run-or-rerun-test([cl-struct-ert--stats t [[cl-struct-ert-test p
  ert-run-tests(t #[385 "...
  ert-run-tests-batch(nil)
  ert-run-tests-batch-and-exit()
  command-line-1(("-L" ":." "-l" "ert" "-l" "package-test.elc" "-f" "e
  command-line()
  normal-top-level()
Test package-test-install-single condition:
    (error "Autoloads file /home/forcer/tmp/pkg-test-user-dir-28222-xD/tmp/pkg-test-user-dir-28222-xD/simple-single-1.3/simple-single-autoloads.el lacks boilerplate")
   FAILED   7/15  package-test-install-single
Importing package-keyring.gpg...
Importing package-keyring.gpg...done
Test package-test-install-single-from-archive backtrace:
  autoload-find-destination("/home/forcer/tmp/pkg-test-user-dir-28222L
  autoload--setup-output(t nil "/home/forcer/tmp/pkg-test-user-dir-282
  autoload-generate-file-autoloads("../../../simple-single-1.3/simple-
  update-directory-autoloads("/home/forcer/tmp/pkg-test-user-dir-28222
  package-generate-autoloads(simple-single "/home/forcer/tmp/pkg-test-
  package--make-autoloads-and-stuff([cl-struct-package-desc simple-sin
  package-unpack([cl-struct-package-desc simple-single (1 3) "A single
  package-install-from-archive([cl-struct-package-desc simple-single (
  mapc(package-install-from-archive ([cl-struct-package-desc simple-si
  package-download-transaction(([cl-struct-package-desc simple-single
  package-install(simple-single)
  #[nil "...
  ert--run-test-internal([cl-struct-ert--test-execution-info [cl-struc
  ert-run-test([cl-struct-ert-test package-test-install-single-from-ar
  ert-run-or-rerun-test([cl-struct-ert--stats t [[cl-struct-ert-test p
  ert-run-tests(t #[385 "...
  ert-run-tests-batch(nil)
  ert-run-tests-batch-and-exit()
  command-line-1(("-L" ":." "-l" "ert" "-l" "package-test.elc" "-f" "e
  command-line()
  normal-top-level()
Test package-test-install-single-from-archive condition:
    (error "Autoloads file /home/forcer/tmp/pkg-test-user-dir-28222L8J/tmp/pkg-test-user-dir-28222L8J/simple-single-1.3/simple-single-autoloads.el lacks boilerplate")
   FAILED   8/15  package-test-install-single-from-archive
Importing package-keyring.gpg...
Importing package-keyring.gpg...done
Test package-test-install-two-dependencies backtrace:
  autoload-find-destination("/home/forcer/tmp/pkg-test-user-dir-28222Y
  autoload--setup-output(t nil "/home/forcer/tmp/pkg-test-user-dir-282
  autoload-generate-file-autoloads("../../../simple-single-1.3/simple-
  update-directory-autoloads("/home/forcer/tmp/pkg-test-user-dir-28222
  package-generate-autoloads(simple-single "/home/forcer/tmp/pkg-test-
  package--make-autoloads-and-stuff([cl-struct-package-desc simple-sin
  package-unpack([cl-struct-package-desc simple-single (1 3) "A single
  package-install-from-archive([cl-struct-package-desc simple-single (
  mapc(package-install-from-archive ([cl-struct-package-desc simple-si
  package-download-transaction(([cl-struct-package-desc simple-single
  package-install(simple-two-depend)
  #[nil "...
  ert--run-test-internal([cl-struct-ert--test-execution-info [cl-struc
  ert-run-test([cl-struct-ert-test package-test-install-two-dependenci
  ert-run-or-rerun-test([cl-struct-ert--stats t [[cl-struct-ert-test p
  ert-run-tests(t #[385 "...
  ert-run-tests-batch(nil)
  ert-run-tests-batch-and-exit()
  command-line-1(("-L" ":." "-l" "ert" "-l" "package-test.elc" "-f" "e
  command-line()
  normal-top-level()
Test package-test-install-two-dependencies condition:
    (error "Autoloads file /home/forcer/tmp/pkg-test-user-dir-28222YGQ/tmp/pkg-test-user-dir-28222YGQ/simple-single-1.3/simple-single-autoloads.el lacks boilerplate")
   FAILED   9/15  package-test-install-two-dependencies
Importing package-keyring.gpg...
Importing package-keyring.gpg...done
   passed  10/15  package-test-refresh-contents
  skipped  11/15  package-test-signed
Importing package-keyring.gpg...
Importing package-keyring.gpg...done
Importing package-keyring.gpg...
Importing package-keyring.gpg...done
Test package-test-update-archives backtrace:
  autoload-find-destination("/home/forcer/tmp/pkg-test-user-dir-28222_
  autoload--setup-output(t nil "/home/forcer/tmp/pkg-test-user-dir-282
  autoload-generate-file-autoloads("../../../simple-single-1.3/simple-
  update-directory-autoloads("/home/forcer/tmp/pkg-test-user-dir-28222
  package-generate-autoloads(simple-single "/home/forcer/tmp/pkg-test-
  package--make-autoloads-and-stuff([cl-struct-package-desc simple-sin
  package-unpack([cl-struct-package-desc simple-single (1 3) "A single
  package-install-from-archive([cl-struct-package-desc simple-single (
  mapc(package-install-from-archive ([cl-struct-package-desc simple-si
  package-download-transaction(([cl-struct-package-desc simple-single
  package-install([cl-struct-package-desc simple-single (1 3) "A singl
  mapc(package-install ([cl-struct-package-desc simple-single (1 3) "A
  package-menu-execute()
  #[nil "...
  ert--run-test-internal([cl-struct-ert--test-execution-info [cl-struc
  ert-run-test([cl-struct-ert-test package-test-update-archives "Test
  ert-run-or-rerun-test([cl-struct-ert--stats t [[cl-struct-ert-test p
  ert-run-tests(t #[385 "...
  ert-run-tests-batch(nil)
  ert-run-tests-batch-and-exit()
  command-line-1(("-L" ":." "-l" "ert" "-l" "package-test.elc" "-f" "e
  command-line()
  normal-top-level()
Test package-test-update-archives condition:
    (error "Autoloads file /home/forcer/tmp/pkg-test-user-dir-28222_ki/tmp/pkg-test-user-dir-28222_ki/simple-single-1.3/simple-single-autoloads.el lacks boilerplate")
   FAILED  12/15  package-test-update-archives
Importing package-keyring.gpg...
Importing package-keyring.gpg...done
Test package-test-update-listing backtrace:
  autoload-find-destination("/home/forcer/tmp/pkg-test-user-dir-28222M
  autoload--setup-output(t nil "/home/forcer/tmp/pkg-test-user-dir-282
  autoload-generate-file-autoloads("../../../simple-single-1.3/simple-
  update-directory-autoloads("/home/forcer/tmp/pkg-test-user-dir-28222
  package-generate-autoloads(simple-single "/home/forcer/tmp/pkg-test-
  package--make-autoloads-and-stuff([cl-struct-package-desc simple-sin
  package-unpack([cl-struct-package-desc simple-single (1 3) "A single
  package-install-from-archive([cl-struct-package-desc simple-single (
  mapc(package-install-from-archive ([cl-struct-package-desc simple-si
  package-download-transaction(([cl-struct-package-desc simple-single
  package-install([cl-struct-package-desc simple-single (1 3) "A singl
  mapc(package-install ([cl-struct-package-desc simple-single (1 3) "A
  package-menu-execute()
  #[nil "...
  ert--run-test-internal([cl-struct-ert--test-execution-info [cl-struc
  ert-run-test([cl-struct-ert-test package-test-update-listing "Ensure
  ert-run-or-rerun-test([cl-struct-ert--stats t [[cl-struct-ert-test p
  ert-run-tests(t #[385 "...
  ert-run-tests-batch(nil)
  ert-run-tests-batch-and-exit()
  command-line-1(("-L" ":." "-l" "ert" "-l" "package-test.elc" "-f" "e
  command-line()
  normal-top-level()
Test package-test-update-listing condition:
    (error "Autoloads file /home/forcer/tmp/pkg-test-user-dir-28222Mvo/tmp/pkg-test-user-dir-28222Mvo/simple-single-1.3/simple-single-autoloads.el lacks boilerplate")
   FAILED  13/15  package-test-update-listing
   passed  14/15  package-x-test-upload-buffer
Test package-x-test-upload-new-version backtrace:
  package--archive-contents-from-file()
  package-upload-buffer-internal([cl-struct-package-desc simple-single
  package-upload-buffer()
  #[nil "...
  ert--run-test-internal([cl-struct-ert--test-execution-info [cl-struc
  ert-run-test([cl-struct-ert-test package-x-test-upload-new-version "
  ert-run-or-rerun-test([cl-struct-ert--stats t [[cl-struct-ert-test p
  ert-run-tests(t #[385 "...
  ert-run-tests-batch(nil)
  ert-run-tests-batch-and-exit()
  command-line-1(("-L" ":." "-l" "ert" "-l" "package-test.elc" "-f" "e
  command-line()
  normal-top-level()
Test package-x-test-upload-new-version condition:
    (end-of-file)
   FAILED  15/15  package-x-test-upload-new-version

Ran 15 tests, 5 results as expected, 9 unexpected, 1 skipped (2015-01-22 19:30:40+0100)

9 unexpected results:
   FAILED  package-test-describe-package
   FAILED  package-test-install-dependency
   FAILED  package-test-install-multifile
   FAILED  package-test-install-single
   FAILED  package-test-install-single-from-archive
   FAILED  package-test-install-two-dependencies
   FAILED  package-test-update-archives
   FAILED  package-test-update-listing
   FAILED  package-x-test-upload-new-version

1 skipped results:
  SKIPPED  package-test-signed





             reply	other threads:[~2015-01-22 19:00 UTC|newest]

Thread overview: 10+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2015-01-22 19:00 Jorgen Schaefer [this message]
2015-01-22 19:38 ` bug#19657: 25.0.50; Test failures in Emacs master, can't figure out what I'm doing wrong Glenn Morris
2015-01-22 19:57   ` Jorgen Schäfer
2015-01-22 20:04     ` Glenn Morris
2015-01-22 23:11       ` Stefan Monnier
2015-01-23  0:50   ` Glenn Morris
2015-01-23  0:54     ` Dmitry Gutov
2015-01-23  2:03       ` Glenn Morris
2015-01-23  9:48       ` Eli Zaretskii
2015-01-23 13:37         ` Dmitry Gutov

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=87sif24p4c.fsf@loki.jorgenschaefer.de \
    --to=contact@jorgenschaefer.de \
    --cc=19657@debbugs.gnu.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
Code repositories for project(s) associated with this external index

	https://git.savannah.gnu.org/cgit/emacs.git
	https://git.savannah.gnu.org/cgit/emacs/org-mode.git

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.