Emacs master: Some tests are hanging.

Emacs master: Some tests are hanging.

[Alan Mackenzie]

Hello, Emacs.

With the Emacs master, updated today:

On a Gentoo GNU/Linux system, when I do

    make -j17 check

, the tests don't finish.  This happens both on a Linux console and in X
Windows on xfce-4-terminal.

The tests which hang are
(i) test/lisp/epg-tests.el (epg-roundtrip-1).
(ii) test/lisp/gnus/mml-sec-tests.el (unknown sub-test).

The hang in (i) is caused by a sub-process running gpg failing to
finish, or to finish cleanly.

I have been seeing this for quite some time (?2 or 3 weeks at least), so
it isn't anything which has just been committed.

Before I raise a proper bug report, has anybody else experienced this?

-- 
Alan Mackenzie (Nuremberg, Germany).

gnupg-2.2.42-r2 [Was: Emacs master: Some tests are hanging.]

[Alan Mackenzie]

Hello, Emacs.

On Thu, Feb 15, 2024 at 15:53:12 +0000, Alan Mackenzie wrote:
> With the Emacs master, updated today:

> On a Gentoo GNU/Linux system, when I do

>     make -j17 check

> , the tests don't finish.  This happens both on a Linux console and in X
> Windows on xfce-4-terminal.

> The tests which hang are
> (i) test/lisp/epg-tests.el (epg-roundtrip-1).
> (ii) test/lisp/gnus/mml-sec-tests.el (unknown sub-test).

> The hang in (i) is caused by a sub-process running gpg failing to
> finish, or to finish cleanly.

> I have been seeing this for quite some time (?2 or 3 weeks at least), so
> it isn't anything which has just been committed.

> Before I raise a proper bug report, has anybody else experienced this?

Right after posting the original post, I tried going back to the
previous version of gnupg, namely gnupg-2.2.41.  All tests then worked
on master, with no hangs.

The version which doesn't work well together with Emacs is
gnupg-2.2.42-r2.  (I've a feeling that the "-r2" there is a purely
Gentoo label).

So it seems that some interface to gnupg has changed, possibly
unintentionally.

I don't know this part of Emacs at all well, that is gnupg and
sub-processes, so would anybody help me on sorting out what's going
wrong, here?  Thanks!

> -- 
> Alan Mackenzie (Nuremberg, Germany).

Re: gnupg-2.2.42-r2 [Was: Emacs master: Some tests are hanging.]

[Eli Zaretskii]

> Date: Thu, 15 Feb 2024 17:38:40 +0000
> From: Alan Mackenzie <acm@muc.de>
> 
> Right after posting the original post, I tried going back to the
> previous version of gnupg, namely gnupg-2.2.41.  All tests then worked
> on master, with no hangs.
> 
> The version which doesn't work well together with Emacs is
> gnupg-2.2.42-r2.  (I've a feeling that the "-r2" there is a purely
> Gentoo label).
> 
> So it seems that some interface to gnupg has changed, possibly
> unintentionally.
> 
> I don't know this part of Emacs at all well, that is gnupg and
> sub-processes, so would anybody help me on sorting out what's going
> wrong, here?  Thanks!

There are known problems with that version of GPG.  We are told that
the latest version 2.4.x solved those problems, so maybe try upgrading
to that.

Re: gnupg-2.2.42-r2 [Was: Emacs master: Some tests are hanging.]

[Sam James]

[-- Attachment #1: Type: text/plain, Size: 1948 bytes --]


Alan Mackenzie <acm@muc.de> writes:

> Hello, Emacs.
>
> On Thu, Feb 15, 2024 at 15:53:12 +0000, Alan Mackenzie wrote:
>> With the Emacs master, updated today:
>
>> On a Gentoo GNU/Linux system, when I do
>
>>     make -j17 check
>
>> , the tests don't finish.  This happens both on a Linux console and in X
>> Windows on xfce-4-terminal.
>
>> The tests which hang are
>> (i) test/lisp/epg-tests.el (epg-roundtrip-1).
>> (ii) test/lisp/gnus/mml-sec-tests.el (unknown sub-test).
>
>> The hang in (i) is caused by a sub-process running gpg failing to
>> finish, or to finish cleanly.
>

We can try compare the output of the failing command with old/new, as
fortunately for debugging, gpg's protocol is simple. See below but it's
probably another subtle state machine change :(

>> I have been seeing this for quite some time (?2 or 3 weeks at least), so
>> it isn't anything which has just been committed.
>
>> Before I raise a proper bug report, has anybody else experienced this?

Can you CC me on anything you end up filing?

>
> Right after posting the original post, I tried going back to the
> previous version of gnupg, namely gnupg-2.2.41.  All tests then worked
> on master, with no hangs.
>
> The version which doesn't work well together with Emacs is
> gnupg-2.2.42-r2.  (I've a feeling that the "-r2" there is a purely
> Gentoo label).

Yeah, it's "ebuild revision".

>
> So it seems that some interface to gnupg has changed, possibly
> unintentionally.
>
> I don't know this part of Emacs at all well, that is gnupg and
> sub-processes, so would anybody help me on sorting out what's going
> wrong, here?  Thanks!

Ugh. We previously had https://bugs.gentoo.org/907839 and
https://dev.gnupg.org/T6481 but I wasn't aware of new issues again
(AFAIK those issues only affected 2.4.x and we backported a fix for it
in Gentoo).

>
>> -- 
>> Alan Mackenzie (Nuremberg, Germany).


[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 377 bytes --]

Re: gnupg-2.2.42-r2 [Was: Emacs master: Some tests are hanging.]

[Alan Mackenzie]

Hello, Sam.

On Thu, Feb 15, 2024 at 21:40:17 +0000, Sam James wrote:

> Alan Mackenzie <acm@muc.de> writes:

> > Hello, Emacs.

> > On Thu, Feb 15, 2024 at 15:53:12 +0000, Alan Mackenzie wrote:
> >> With the Emacs master, updated today:

> >> On a Gentoo GNU/Linux system, when I do

> >>     make -j17 check

> >> , the tests don't finish.  This happens both on a Linux console and in X
> >> Windows on xfce-4-terminal.

> >> The tests which hang are
> >> (i) test/lisp/epg-tests.el (epg-roundtrip-1).
> >> (ii) test/lisp/gnus/mml-sec-tests.el (unknown sub-test).

> >> The hang in (i) is caused by a sub-process running gpg failing to
> >> finish, or to finish cleanly.


> We can try compare the output of the failing command with old/new, as
> fortunately for debugging, gpg's protocol is simple. See below but it's
> probably another subtle state machine change :(

> >> I have been seeing this for quite some time (?2 or 3 weeks at least), so
> >> it isn't anything which has just been committed.

> >> Before I raise a proper bug report, has anybody else experienced this?

> Can you CC me on anything you end up filing?

Yes, I'll do that.  Though I don't think I'll be raising an Emacs bug for
this, since the issue is already known.

> > Right after posting the original post, I tried going back to the
> > previous version of gnupg, namely gnupg-2.2.41.  All tests then worked
> > on master, with no hangs.

> > The version which doesn't work well together with Emacs is
> > gnupg-2.2.42-r2.  (I've a feeling that the "-r2" there is a purely
> > Gentoo label).

> Yeah, it's "ebuild revision".

OK, I didn't know that, thanks!

> > So it seems that some interface to gnupg has changed, possibly
> > unintentionally.

> > I don't know this part of Emacs at all well, that is gnupg and
> > sub-processes, so would anybody help me on sorting out what's going
> > wrong, here?  Thanks!

> Ugh. We previously had https://bugs.gentoo.org/907839 and
> https://dev.gnupg.org/T6481 but I wasn't aware of new issues again
> (AFAIK those issues only affected 2.4.x and we backported a fix for it
> in Gentoo).

As I said, I see the bug with gnupg-2.2.42-r2.  I can get by with 2.2.41
for now, until 2.4.4 gets stabilised in Gentoo.

-- 
Alan Mackenzie (Nuremberg, Germany).