bug#59061: bwrap-related Emacs test failure on Ubuntu 22.10

bug#59061: bwrap-related Emacs test failure on Ubuntu 22.10

[Paul Eggert]

[-- Attachment #1: Type: text/plain, Size: 546 bytes --]

This is on Ubuntu 22.10 x86-64, with current Emacs master (commit 
8a49a888532c955ae81855636a65b446508cb361 dated today). "make check" 
fails in some of the bubblewrap tests. Some bwrap expertise (which I 
don't have) would be of use in debugging this so I'm taking the liberty 
of cc'ing Philipp.

I'm attaching a copy of the build log (created with ./autogen.sh; 
configure; make; make check) and of the test failure logged in 
test/src/emacs-tests.log.

There are other test failures and if I get time I plan to file bug 
reports for them too.

[-- Attachment #2: build-log.gz --]
[-- Type: application/gzip, Size: 31397 bytes --]

[-- Attachment #3: emacs-tests.log --]
[-- Type: text/x-log, Size: 2949 bytes --]

Running 7 tests (2022-11-05 12:11:07-0700, selector ‘(not (or (tag :expensive-test) (tag :unstable) (tag :nativecomp)))’)
Test emacs-tests/bwrap/allows-stdout backtrace:
  signal(ert-test-failed (((should (eql status 0)) :form (eql 159 0) :
  ert-fail(((should (eql status 0)) :form (eql 159 0) :value nil))
  #f(compiled-function () #<bytecode 0x1ba5192d57495e9f>)()
  ert--run-test-internal(#s(ert--test-execution-info :test #s(ert-test
  ert-run-test(#s(ert-test :name emacs-tests/bwrap/allows-stdout :docu
  ert-run-or-rerun-test(#s(ert--stats :selector (not (or ... ... ...))
  ert-run-tests((not (or (tag :expensive-test) (tag :unstable) (tag :n
  ert-run-tests-batch((not (or (tag :expensive-test) (tag :unstable) (
  ert-run-tests-batch-and-exit((not (or (tag :expensive-test) (tag :un
  eval((ert-run-tests-batch-and-exit '(not (or (tag :expensive-test) (
  command-line-1(("-L" ":." "-l" "ert" "-l" "src/emacs-tests" "--eval"
  command-line()
  normal-top-level()
Test emacs-tests/bwrap/allows-stdout condition:
    Info: Process output:
          
    (ert-test-failed
     ((should
       (eql status 0))
      :form
      (eql 159 0)
      :value nil))
   FAILED  1/7  emacs-tests/bwrap/allows-stdout (0.114432 sec) at src/emacs-tests.el:175
   passed  2/7  emacs-tests/seccomp/absent-file (0.015406 sec)
Test emacs-tests/seccomp/allows-stdout backtrace:
  signal(ert-test-failed (((should (eql status 0)) :form (eql "Bad sys
  ert-fail(((should (eql status 0)) :form (eql "Bad system call" 0) :v
  #f(compiled-function () #<bytecode -0xdcd8d3d483ef606>)()
  ert--run-test-internal(#s(ert--test-execution-info :test #s(ert-test
  ert-run-test(#s(ert-test :name emacs-tests/seccomp/allows-stdout :do
  ert-run-or-rerun-test(#s(ert--stats :selector (not (or ... ... ...))
  ert-run-tests((not (or (tag :expensive-test) (tag :unstable) (tag :n
  ert-run-tests-batch((not (or (tag :expensive-test) (tag :unstable) (
  ert-run-tests-batch-and-exit((not (or (tag :expensive-test) (tag :un
  eval((ert-run-tests-batch-and-exit '(not (or (tag :expensive-test) (
  command-line-1(("-L" ":." "-l" "ert" "-l" "src/emacs-tests" "--eval"
  command-line()
  normal-top-level()
Test emacs-tests/seccomp/allows-stdout condition:
    Info: Process output:
          
    (ert-test-failed
     ((should
       (eql status 0))
      :form
      (eql "Bad system call" 0)
      :value nil))
   FAILED  3/7  emacs-tests/seccomp/allows-stdout (0.111244 sec) at src/emacs-tests.el:122
   passed  4/7  emacs-tests/seccomp/empty-file (0.015778 sec)
   passed  5/7  emacs-tests/seccomp/file-too-large (0.031031 sec)
   passed  6/7  emacs-tests/seccomp/forbids-subprocess (0.111947 sec)
   passed  7/7  emacs-tests/seccomp/invalid-file-size (0.015693 sec)

Ran 7 tests, 5 results as expected, 2 unexpected (2022-11-05 12:11:07-0700, 0.512199 sec)

2 unexpected results:
   FAILED  emacs-tests/bwrap/allows-stdout
   FAILED  emacs-tests/seccomp/allows-stdout

bug#59061: bwrap-related Emacs test failure on Ubuntu 22.10

[Matt Armstrong]

Paul Eggert <eggert@cs.ucla.edu> writes:

> This is on Ubuntu 22.10 x86-64, with current Emacs master (commit
> 8a49a888532c955ae81855636a65b446508cb361 dated today). "make check" fails
> in some of the bubblewrap tests. Some bwrap expertise (which I don't have)
> would be of use in debugging this so I'm taking the liberty of cc'ing
> Philipp.
>
> I'm attaching a copy of the build log (created with ./autogen.sh;
> configure; make; make check) and of the test failure logged in
> test/src/emacs-tests.log.

I was able to reproduce this on a Debian Testing system after installing
the "libseccomp-dev" package.  The test failures I get are identical to
Paul's.

Without that package lib-src/Makefile refrains from building
lib-src/seccomp-filter.bpf, which in turn causes these tests to be
skipped.  This may explain why chatter about these failures has been
low.

bug#59061: bwrap-related Emacs test failure on Ubuntu 22.10

[Philipp Stephani via Bug reports for GNU Emacs, the Swiss army knife of text editors]

On Thu, 17 Nov 2022 at 01:26, Matt Armstrong <matt@rfc20.org> wrote:
>
> Paul Eggert <eggert@cs.ucla.edu> writes:
>
> > This is on Ubuntu 22.10 x86-64, with current Emacs master (commit
> > 8a49a888532c955ae81855636a65b446508cb361 dated today). "make check" fails
> > in some of the bubblewrap tests. Some bwrap expertise (which I don't have)
> > would be of use in debugging this so I'm taking the liberty of cc'ing
> > Philipp.
> >
> > I'm attaching a copy of the build log (created with ./autogen.sh;
> > configure; make; make check) and of the test failure logged in
> > test/src/emacs-tests.log.
>
> I was able to reproduce this on a Debian Testing system after installing
> the "libseccomp-dev" package.  The test failures I get are identical to
> Paul's.
>
> Without that package lib-src/Makefile refrains from building
> lib-src/seccomp-filter.bpf, which in turn causes these tests to be
> skipped.  This may explain why chatter about these failures has been
> low.

I've now tried to fix this with commit 940d9070e97858fdb6c0d84fc5617b8c10dab0ba.

-- 
Google Germany GmbH
Erika-Mann-Straße 33
80636 München

Geschäftsführer: Paul Manicle, Liana Sebastian
Registergericht und -nummer: Hamburg, HRB 86891
Sitz der Gesellschaft: Hamburg

Diese E-Mail ist vertraulich. Falls Sie diese fälschlicherweise
erhalten haben sollten, leiten Sie diese bitte nicht an jemand anderes
weiter, löschen Sie alle Kopien und Anhänge davon und lassen Sie mich
bitte wissen, dass die E-Mail an die falsche Person gesendet wurde.

This e-mail is confidential. If you received this communication by
mistake, please don’t forward it to anyone else, please erase all
copies and attachments, and please let me know that it has gone to the
wrong person.

bug#59061: bwrap-related Emacs test failure on Ubuntu 22.10

[Philipp Stephani via Bug reports for GNU Emacs, the Swiss army knife of text editors]

On Sat, 5 Nov 2022 at 22:39, Paul Eggert <eggert@cs.ucla.edu> wrote:
>
> This is on Ubuntu 22.10 x86-64, with current Emacs master (commit
> 8a49a888532c955ae81855636a65b446508cb361 dated today). "make check"
> fails in some of the bubblewrap tests. Some bwrap expertise (which I
> don't have) would be of use in debugging this so I'm taking the liberty
> of cc'ing Philipp.
>
> I'm attaching a copy of the build log (created with ./autogen.sh;
> configure; make; make check) and of the test failure logged in
> test/src/emacs-tests.log.
>
> There are other test failures and if I get time I plan to file bug
> reports for them too.

I've tried to address this with commit 940d9070e97858fdb6c0d84fc5617b8c10dab0ba.

-- 
Google Germany GmbH
Erika-Mann-Straße 33
80636 München

Geschäftsführer: Paul Manicle, Liana Sebastian
Registergericht und -nummer: Hamburg, HRB 86891
Sitz der Gesellschaft: Hamburg

Diese E-Mail ist vertraulich. Falls Sie diese fälschlicherweise
erhalten haben sollten, leiten Sie diese bitte nicht an jemand anderes
weiter, löschen Sie alle Kopien und Anhänge davon und lassen Sie mich
bitte wissen, dass die E-Mail an die falsche Person gesendet wurde.

This e-mail is confidential. If you received this communication by
mistake, please don’t forward it to anyone else, please erase all
copies and attachments, and please let me know that it has gone to the
wrong person.

bug#59061: bwrap-related Emacs test failure on Ubuntu 22.10

[Stefan Kangas]

Philipp Stephani <phst@google.com> writes:

> On Thu, 17 Nov 2022 at 01:26, Matt Armstrong <matt@rfc20.org> wrote:
>>
>> Paul Eggert <eggert@cs.ucla.edu> writes:
>>
>> > This is on Ubuntu 22.10 x86-64, with current Emacs master (commit
>> > 8a49a888532c955ae81855636a65b446508cb361 dated today). "make check" fails
>> > in some of the bubblewrap tests. Some bwrap expertise (which I don't have)
>> > would be of use in debugging this so I'm taking the liberty of cc'ing
>> > Philipp.
>> >
>> > I'm attaching a copy of the build log (created with ./autogen.sh;
>> > configure; make; make check) and of the test failure logged in
>> > test/src/emacs-tests.log.
>>
>> I was able to reproduce this on a Debian Testing system after installing
>> the "libseccomp-dev" package.  The test failures I get are identical to
>> Paul's.
>>
>> Without that package lib-src/Makefile refrains from building
>> lib-src/seccomp-filter.bpf, which in turn causes these tests to be
>> skipped.  This may explain why chatter about these failures has been
>> low.
>
> I've now tried to fix this with commit 940d9070e97858fdb6c0d84fc5617b8c10dab0ba.

No followups within 10 months, so I guess the fix worked.  I'm therefore
closing this bug report.  Please reopen if this is still an issue.