steve [ ~ ]$ cd ~/src/emacs/emacs-master/test/lisp/progmodes/
steve [ ~/src/emacs/emacs-master/test/lisp/progmodes ]$ emacs-master -batch -l ert -l elisp-mode-tests.el -f ert-run-tests-batch-and-exit
Running 46 tests (2020-10-16 22:31:08+0200, selector ‘t’)
   passed   1/46  elisp--highlight-function-argument-indexed (0.000164 sec)
   passed   2/46  elisp--highlight-function-argument-keyed-1 (0.000199 sec)
   passed   3/46  elisp--highlight-function-argument-keyed-2 (0.000163 sec)
   passed   4/46  elisp--preceding-sexp--char-name (0.000108 sec)
   passed   5/46  elisp-completes-anything-quoted (0.010978 sec)
   passed   6/46  elisp-completes-functions (0.001097 sec)
   passed   7/46  elisp-completes-functions-after-hash-quote (0.000085 sec)
   passed   8/46  elisp-completes-functions-after-let-bindings (0.001057 sec)
   passed   9/46  elisp-completes-functions-in-special-macros (0.002016 sec)
   passed  10/46  elisp-completes-local-variables (0.001070 sec)
   passed  11/46  elisp-completes-variables (0.001058 sec)
   passed  12/46  elisp-completes-variables-unquoted (0.003069 sec)
   passed  13/46  elisp-completest-variables-in-let-bindings (0.002225 sec)
Indenting region... 
Indenting region...done
   passed  14/46  elisp-indent-basic (0.000288 sec)
   passed  15/46  eval-last-sexp-print-format-large-int (0.000165 sec)
  skipped  16/46  eval-last-sexp-print-format-large-int-echo (0.000091 sec)
   passed  17/46  eval-last-sexp-print-format-small-int (0.000090 sec)
  skipped  18/46  eval-last-sexp-print-format-small-int-echo (0.000125 sec)
   passed  19/46  eval-last-sexp-print-format-sym (0.000055 sec)
  skipped  20/46  eval-last-sexp-print-format-sym-echo (0.000072 sec)
   passed  21/46  xref-elisp-test-find-defs-constructor (0.030686 sec)
   passed  22/46  xref-elisp-test-find-defs-defalias-defun-el (0.013515 sec)
   passed  23/46  xref-elisp-test-find-defs-defgeneric-co-located-default (0.010218 sec)
   passed  24/46  xref-elisp-test-find-defs-defgeneric-el (0.015510 sec)
   passed  25/46  xref-elisp-test-find-defs-defgeneric-eval (0.000188 sec)
   passed  26/46  xref-elisp-test-find-defs-defgeneric-implicit-generic (0.001169 sec)
   passed  27/46  xref-elisp-test-find-defs-defgeneric-no-default (0.001111 sec)
   passed  28/46  xref-elisp-test-find-defs-defgeneric-no-methods (0.000652 sec)
   passed  29/46  xref-elisp-test-find-defs-defgeneric-separate-default (0.014258 sec)
   passed  30/46  xref-elisp-test-find-defs-define-overload-co-located-default (0.005824 sec)
   passed  31/46  xref-elisp-test-find-defs-define-overload-no-default (0.003958 sec)
   passed  32/46  xref-elisp-test-find-defs-define-overload-no-methods (0.002439 sec)
   passed  33/46  xref-elisp-test-find-defs-define-overload-separate-default (0.003328 sec)
   passed  34/46  xref-elisp-test-find-defs-defun-c (0.097183 sec)
   passed  35/46  xref-elisp-test-find-defs-defun-c-defvar-c (0.027612 sec)
   passed  36/46  xref-elisp-test-find-defs-defun-defvar-el (0.009292 sec)
   passed  37/46  xref-elisp-test-find-defs-defun-el (0.001261 sec)
   passed  38/46  xref-elisp-test-find-defs-defun-el-defvar-c (0.009443 sec)
   passed  39/46  xref-elisp-test-find-defs-defun-eval (0.000340 sec)
   passed  40/46  xref-elisp-test-find-defs-defvar-c (0.002124 sec)
   passed  41/46  xref-elisp-test-find-defs-defvar-el (0.000751 sec)
   passed  42/46  xref-elisp-test-find-defs-defvar-eval (0.000117 sec)
   passed  43/46  xref-elisp-test-find-defs-face-el (0.022559 sec)
   passed  44/46  xref-elisp-test-find-defs-face-eval (0.000318 sec)
   passed  45/46  xref-elisp-test-find-defs-feature-el (0.000655 sec)
   passed  46/46  xref-elisp-test-find-defs-feature-eval (0.001085 sec)

Ran 46 tests, 43 results as expected, 0 unexpected, 3 skipped (2020-10-16 22:31:08+0200, 0.301689 sec)

3 skipped results:
  SKIPPED  eval-last-sexp-print-format-large-int-echo
  SKIPPED  eval-last-sexp-print-format-small-int-echo
  SKIPPED  eval-last-sexp-print-format-sym-echo

steve [ ~/src/emacs/emacs-master/test/lisp/progmodes ]$ cd /datadisk/steve/src/emacs/emacs-master/test/lisp/progmodes/
steve [ /datadisk/steve/src/emacs/emacs-master/test/lisp/progmodes ]$ emacs-master -batch -l ert -l elisp-mode-tests.el -f ert-run-tests-batch-and-exit
Running 46 tests (2020-10-16 22:32:16+0200, selector ‘t’)
   passed   1/46  elisp--highlight-function-argument-indexed (0.000149 sec)
   passed   2/46  elisp--highlight-function-argument-keyed-1 (0.000199 sec)
   passed   3/46  elisp--highlight-function-argument-keyed-2 (0.000161 sec)
   passed   4/46  elisp--preceding-sexp--char-name (0.000106 sec)
   passed   5/46  elisp-completes-anything-quoted (0.009869 sec)
   passed   6/46  elisp-completes-functions (0.001164 sec)
   passed   7/46  elisp-completes-functions-after-hash-quote (0.000056 sec)
   passed   8/46  elisp-completes-functions-after-let-bindings (0.001062 sec)
   passed   9/46  elisp-completes-functions-in-special-macros (0.002005 sec)
   passed  10/46  elisp-completes-local-variables (0.001122 sec)
   passed  11/46  elisp-completes-variables (0.001043 sec)
   passed  12/46  elisp-completes-variables-unquoted (0.003025 sec)
   passed  13/46  elisp-completest-variables-in-let-bindings (0.001980 sec)
Indenting region... 
Indenting region...done
   passed  14/46  elisp-indent-basic (0.000274 sec)
   passed  15/46  eval-last-sexp-print-format-large-int (0.000108 sec)
  skipped  16/46  eval-last-sexp-print-format-large-int-echo (0.000090 sec)
   passed  17/46  eval-last-sexp-print-format-small-int (0.000085 sec)
  skipped  18/46  eval-last-sexp-print-format-small-int-echo (0.000089 sec)
   passed  19/46  eval-last-sexp-print-format-sym (0.000056 sec)
  skipped  20/46  eval-last-sexp-print-format-sym-echo (0.000072 sec)
   passed  21/46  xref-elisp-test-find-defs-constructor (0.027042 sec)
   passed  22/46  xref-elisp-test-find-defs-defalias-defun-el (0.014630 sec)
   passed  23/46  xref-elisp-test-find-defs-defgeneric-co-located-default (0.007012 sec)
Test xref-elisp-test-find-defs-defgeneric-el backtrace:
  signal(ert-test-failed (((should (equal xref expected-xref)) :form (
  ert-fail(((should (equal xref expected-xref)) :form (equal #<xref-it
  (if (unwind-protect (setq value-222 (apply fn-220 args-221)) (setq f
  (let (form-description-224) (if (unwind-protect (setq value-222 (app
  (let ((value-222 'ert-form-evaluation-aborted-223)) (let (form-descr
  (let* ((fn-220 #'equal) (args-221 (condition-case err (let ((signal-
  (let* ((xref (car-safe (prog1 xrefs (setq xrefs (cdr xrefs))))) (exp
  (while xrefs (let* ((xref (car-safe (prog1 xrefs (setq xrefs (cdr xr
  xref-elisp-test-run((#<xref-item xref-item-a47932> #<xref-item xref-
  (let ((find-file-suppress-same-file-warnings t)) (xref-elisp-test-ru
  (closure (cl-struct-xref-elisp-root-type-tags t) nil (let ((find-fil
  ert--run-test-internal(#s(ert--test-execution-info :test #s(ert-test
  ert-run-test(#s(ert-test :name xref-elisp-test-find-defs-defgeneric-
  ert-run-or-rerun-test(#s(ert--stats :selector t :tests ... :test-map
  ert-run-tests(t #f(compiled-function (event-type &rest event-args) #
  ert-run-tests-batch(nil)
  ert-run-tests-batch-and-exit()
  command-line-1(("-l" "ert" "-l" "elisp-mode-tests.el" "-f" "ert-run-
  command-line()
  normal-top-level()
Test xref-elisp-test-find-defs-defgeneric-el condition:
    (ert-test-failed
     ((should
       (equal xref expected-xref))
      :form
      (equal #s(xref-item
		#("(cl-defgeneric xref-location-marker)" 1 14 ... 15 35 ...)
		#s(xref-elisp-location xref-location-marker cl-defgeneric "/home/steve/src/emacs/emacs-master/lisp/progmodes/xref.el"))
	      #s(xref-item "(cl-defgeneric xref-location-marker)" #s(xref-elisp-location xref-location-marker cl-defgeneric "/datadisk/steve/src/emacs/emacs-master/lisp/progmodes/xref.el")))
      :value nil :explanation
      (array-elt 2
		 (struct-field file
			       (arrays-of-different-length 57 61 "/home/steve/src/emacs/emacs-master/lisp/progmodes/xref.el" "/datadisk/steve/src/emacs/emacs-master/lisp/progmodes/xref.el" first-mismatch-at 1)))))
   FAILED  24/46  xref-elisp-test-find-defs-defgeneric-el (0.000845 sec)
   passed  25/46  xref-elisp-test-find-defs-defgeneric-eval (0.000156 sec)
   passed  26/46  xref-elisp-test-find-defs-defgeneric-implicit-generic (0.000990 sec)
   passed  27/46  xref-elisp-test-find-defs-defgeneric-no-default (0.000866 sec)
   passed  28/46  xref-elisp-test-find-defs-defgeneric-no-methods (0.000454 sec)
   passed  29/46  xref-elisp-test-find-defs-defgeneric-separate-default (0.001363 sec)
   passed  30/46  xref-elisp-test-find-defs-define-overload-co-located-default (0.005104 sec)
   passed  31/46  xref-elisp-test-find-defs-define-overload-no-default (0.003468 sec)
   passed  32/46  xref-elisp-test-find-defs-define-overload-no-methods (0.002156 sec)
   passed  33/46  xref-elisp-test-find-defs-define-overload-separate-default (0.002859 sec)
   passed  34/46  xref-elisp-test-find-defs-defun-c (0.092257 sec)
   passed  35/46  xref-elisp-test-find-defs-defun-c-defvar-c (0.027617 sec)
Test xref-elisp-test-find-defs-defun-defvar-el backtrace:
  signal(ert-test-failed (((should (equal xref expected-xref)) :form (
  ert-fail(((should (equal xref expected-xref)) :form (equal #<xref-it
  (if (unwind-protect (setq value-222 (apply fn-220 args-221)) (setq f
  (let (form-description-224) (if (unwind-protect (setq value-222 (app
  (let ((value-222 'ert-form-evaluation-aborted-223)) (let (form-descr
  (let* ((fn-220 #'equal) (args-221 (condition-case err (let ((signal-
  (let* ((xref (car-safe (prog1 xrefs (setq xrefs (cdr xrefs))))) (exp
  (while xrefs (let* ((xref (car-safe (prog1 xrefs (setq xrefs (cdr xr
  xref-elisp-test-run((#<xref-item xref-item-ba0646>) ((#<xref-item xr
  (let ((find-file-suppress-same-file-warnings t)) (xref-elisp-test-ru
  (closure (cl-struct-xref-elisp-root-type-tags t) nil (let ((find-fil
  ert--run-test-internal(#s(ert--test-execution-info :test #s(ert-test
  ert-run-test(#s(ert-test :name xref-elisp-test-find-defs-defun-defva
  ert-run-or-rerun-test(#s(ert--stats :selector t :tests ... :test-map
  ert-run-tests(t #f(compiled-function (event-type &rest event-args) #
  ert-run-tests-batch(nil)
  ert-run-tests-batch-and-exit()
  command-line-1(("-l" "ert" "-l" "elisp-mode-tests.el" "-f" "ert-run-
  command-line()
  normal-top-level()
Test xref-elisp-test-find-defs-defun-defvar-el condition:
    (ert-test-failed
     ((should
       (equal xref expected-xref))
      :form
      (equal #s(xref-item
		#("(defun compilation-minor-mode)" 1 6 ... 7 29 ...)
		#s(xref-elisp-location compilation-minor-mode nil "/home/steve/src/emacs/emacs-master/lisp/progmodes/compile.el"))
	      #s(xref-item "(defun compilation-minor-mode)" #s(xref-elisp-location compilation-minor-mode nil "/datadisk/steve/src/emacs/emacs-master/lisp/progmodes/compile.el")))
      :value nil :explanation
      (array-elt 2
		 (struct-field file
			       (arrays-of-different-length 60 64 "/home/steve/src/emacs/emacs-master/lisp/progmodes/compile.el" "/datadisk/steve/src/emacs/emacs-master/lisp/progmodes/compile.el" first-mismatch-at 1)))))
   FAILED  36/46  xref-elisp-test-find-defs-defun-defvar-el (0.000341 sec)
Test xref-elisp-test-find-defs-defun-el backtrace:
  signal(ert-test-failed (((should (equal xref expected-xref)) :form (
  ert-fail(((should (equal xref expected-xref)) :form (equal #<xref-it
  (if (unwind-protect (setq value-222 (apply fn-220 args-221)) (setq f
  (let (form-description-224) (if (unwind-protect (setq value-222 (app
  (let ((value-222 'ert-form-evaluation-aborted-223)) (let (form-descr
  (let* ((fn-220 #'equal) (args-221 (condition-case err (let ((signal-
  (let* ((xref (car-safe (prog1 xrefs (setq xrefs (cdr xrefs))))) (exp
  (while xrefs (let* ((xref (car-safe (prog1 xrefs (setq xrefs (cdr xr
  xref-elisp-test-run((#<xref-item xref-item-acba8e>) (#<xref-item xre
  (let ((find-file-suppress-same-file-warnings t)) (xref-elisp-test-ru
  (closure (cl-struct-xref-elisp-root-type-tags t) nil (let ((find-fil
  ert--run-test-internal(#s(ert--test-execution-info :test #s(ert-test
  ert-run-test(#s(ert-test :name xref-elisp-test-find-defs-defun-el :d
  ert-run-or-rerun-test(#s(ert--stats :selector t :tests ... :test-map
  ert-run-tests(t #f(compiled-function (event-type &rest event-args) #
  ert-run-tests-batch(nil)
  ert-run-tests-batch-and-exit()
  command-line-1(("-l" "ert" "-l" "elisp-mode-tests.el" "-f" "ert-run-
  command-line()
  normal-top-level()
Test xref-elisp-test-find-defs-defun-el condition:
    (ert-test-failed
     ((should
       (equal xref expected-xref))
      :form
      (equal #s(xref-item
		#("(defun xref-find-definitions)" 1 6 ... 7 28 ...)
		#s(xref-elisp-location xref-find-definitions nil "/home/steve/src/emacs/emacs-master/lisp/progmodes/xref.el"))
	      #s(xref-item "(defun xref-find-definitions)" #s(xref-elisp-location xref-find-definitions nil "/datadisk/steve/src/emacs/emacs-master/lisp/progmodes/xref.el")))
      :value nil :explanation
      (array-elt 2
		 (struct-field file
			       (arrays-of-different-length 57 61 "/home/steve/src/emacs/emacs-master/lisp/progmodes/xref.el" "/datadisk/steve/src/emacs/emacs-master/lisp/progmodes/xref.el" first-mismatch-at 1)))))
   FAILED  37/46  xref-elisp-test-find-defs-defun-el (0.000323 sec)
   passed  38/46  xref-elisp-test-find-defs-defun-el-defvar-c (0.010689 sec)
   passed  39/46  xref-elisp-test-find-defs-defun-eval (0.000454 sec)
   passed  40/46  xref-elisp-test-find-defs-defvar-c (0.002041 sec)
Test xref-elisp-test-find-defs-defvar-el backtrace:
  signal(ert-test-failed (((should (equal xref expected-xref)) :form (
  ert-fail(((should (equal xref expected-xref)) :form (equal #<xref-it
  (if (unwind-protect (setq value-222 (apply fn-220 args-221)) (setq f
  (let (form-description-224) (if (unwind-protect (setq value-222 (app
  (let ((value-222 'ert-form-evaluation-aborted-223)) (let (form-descr
  (let* ((fn-220 #'equal) (args-221 (condition-case err (let ((signal-
  (let* ((xref (car-safe (prog1 xrefs (setq xrefs (cdr xrefs))))) (exp
  (while xrefs (let* ((xref (car-safe (prog1 xrefs (setq xrefs (cdr xr
  xref-elisp-test-run((#<xref-item xref-item-b6b684>) (#<xref-item xre
  (let ((find-file-suppress-same-file-warnings t)) (xref-elisp-test-ru
  (closure (cl-struct-xref-elisp-root-type-tags t) nil (let ((find-fil
  ert--run-test-internal(#s(ert--test-execution-info :test #s(ert-test
  ert-run-test(#s(ert-test :name xref-elisp-test-find-defs-defvar-el :
  ert-run-or-rerun-test(#s(ert--stats :selector t :tests ... :test-map
  ert-run-tests(t #f(compiled-function (event-type &rest event-args) #
  ert-run-tests-batch(nil)
  ert-run-tests-batch-and-exit()
  command-line-1(("-l" "ert" "-l" "elisp-mode-tests.el" "-f" "ert-run-
  command-line()
  normal-top-level()
Test xref-elisp-test-find-defs-defvar-el condition:
    (ert-test-failed
     ((should
       (equal xref expected-xref))
      :form
      (equal #s(xref-item
		#("(defvar xref--marker-ring)" 1 7 ... 8 25 ...)
		#s(xref-elisp-location xref--marker-ring defvar "/home/steve/src/emacs/emacs-master/lisp/progmodes/xref.el"))
	      #s(xref-item "(defvar xref--marker-ring)" #s(xref-elisp-location xref--marker-ring defvar "/datadisk/steve/src/emacs/emacs-master/lisp/progmodes/xref.el")))
      :value nil :explanation
      (array-elt 2
		 (struct-field file
			       (arrays-of-different-length 57 61 "/home/steve/src/emacs/emacs-master/lisp/progmodes/xref.el" "/datadisk/steve/src/emacs/emacs-master/lisp/progmodes/xref.el" first-mismatch-at 1)))))
   FAILED  41/46  xref-elisp-test-find-defs-defvar-el (0.000203 sec)
   passed  42/46  xref-elisp-test-find-defs-defvar-eval (0.000166 sec)
   passed  43/46  xref-elisp-test-find-defs-face-el (0.010067 sec)
   passed  44/46  xref-elisp-test-find-defs-face-eval (0.000463 sec)
Test xref-elisp-test-find-defs-feature-el backtrace:
  signal(ert-test-failed (((should (equal xref expected-xref)) :form (
  ert-fail(((should (equal xref expected-xref)) :form (equal #<xref-it
  (if (unwind-protect (setq value-222 (apply fn-220 args-221)) (setq f
  (let (form-description-224) (if (unwind-protect (setq value-222 (app
  (let ((value-222 'ert-form-evaluation-aborted-223)) (let (form-descr
  (let* ((fn-220 #'equal) (args-221 (condition-case err (let ((signal-
  (let* ((xref (car-safe (prog1 xrefs (setq xrefs (cdr xrefs))))) (exp
  (while xrefs (let* ((xref (car-safe (prog1 xrefs (setq xrefs (cdr xr
  xref-elisp-test-run((#<xref-item xref-item-a574e4>) ((#<xref-item xr
  (let ((find-file-suppress-same-file-warnings t)) (xref-elisp-test-ru
  (closure (cl-struct-xref-elisp-root-type-tags t) nil (let ((find-fil
  ert--run-test-internal(#s(ert--test-execution-info :test #s(ert-test
  ert-run-test(#s(ert-test :name xref-elisp-test-find-defs-feature-el 
  ert-run-or-rerun-test(#s(ert--stats :selector t :tests ... :test-map
  ert-run-tests(t #f(compiled-function (event-type &rest event-args) #
  ert-run-tests-batch(nil)
  ert-run-tests-batch-and-exit()
  command-line-1(("-l" "ert" "-l" "elisp-mode-tests.el" "-f" "ert-run-
  command-line()
  normal-top-level()
Test xref-elisp-test-find-defs-feature-el condition:
    (ert-test-failed
     ((should
       (equal xref expected-xref))
      :form
      (equal #s(xref-item
		#("(feature xref)" 1 8 ... 9 13 ...)
		#s(xref-elisp-location xref feature "/home/steve/src/emacs/emacs-master/lisp/progmodes/xref.el"))
	      #s(xref-item "(feature xref)" #s(xref-elisp-location xref feature "/datadisk/steve/src/emacs/emacs-master/lisp/progmodes/xref.el")))
      :value nil :explanation
      (array-elt 2
		 (struct-field file
			       (arrays-of-different-length 57 61 "/home/steve/src/emacs/emacs-master/lisp/progmodes/xref.el" "/datadisk/steve/src/emacs/emacs-master/lisp/progmodes/xref.el" first-mismatch-at 1)))))
   FAILED  45/46  xref-elisp-test-find-defs-feature-el (0.000272 sec)
   passed  46/46  xref-elisp-test-find-defs-feature-eval (0.001159 sec)

Ran 46 tests, 38 results as expected, 5 unexpected, 3 skipped (2020-10-16 22:32:17+0200, 1.046538 sec)

5 unexpected results:
   FAILED  xref-elisp-test-find-defs-defgeneric-el
   FAILED  xref-elisp-test-find-defs-defun-defvar-el
   FAILED  xref-elisp-test-find-defs-defun-el
   FAILED  xref-elisp-test-find-defs-defvar-el
   FAILED  xref-elisp-test-find-defs-feature-el

3 skipped results:
  SKIPPED  eval-last-sexp-print-format-large-int-echo
  SKIPPED  eval-last-sexp-print-format-small-int-echo
  SKIPPED  eval-last-sexp-print-format-sym-echo

steve [ /datadisk/steve/src/emacs/emacs-master/test/lisp/progmodes ]$