Re: Test failures with 1.7.0

[Eric Wong <e@80x24.org>]

Julien Moutinho <julm+public-inbox@sourcephile.fr> wrote:
> Hi!
> 
> I'm trying to package the new 1.7.0 public-inbox into NixOS
> at https://github.com/NixOS/nixpkgs/pull/104457
> but two reviewers are facing different test failures
> that I cannot reproduce:
> 
> One reviewer and a bot fail with:
> > t/lei_to_mail.t .............. 1/? Use of uninitialized value in open at t/lei_to_mail.t line 263.
> > Bailout called.  Further testing stopped:  No such file or directory
> > FAILED--Further testing stopped: No such file or directory
> 
> And another reviewer fails 3 times with:
> > t/extsearch.t              (Wstat: 2048 Tests: 145 Failed: 8)
> >   Failed tests:  68-69, 75-76, 86, 98, 102, 139
> >   Non-zero exit status: 8
> > t/imapd.t                  (Wstat: 256 Tests: 186 Failed: 1)
> >   Failed test:  183
> >   Non-zero exit status: 1
> > t/nntpd.t                  (Wstat: 256 Tests: 110 Failed: 1)
> >   Failed test:  104
> >   Non-zero exit status: 1

Sorry for the problems....

I wonder if it's a missing dependency that the tests forget to
account for...  Can they run the tests individually using "prove"
and show more output?

   e.g.: make && prove -bvw t/nntpd.t

Also, "./lei.sh sucks"  will dump the relevant deps+versions
(either Inline::C or Socket::MsgHdr is required for lei to work)

> Nix being Nix we can assume the exact same code is used for all,
> but our systems are different (eg. CPU(s), filesystem(s), etc.)

Perhaps you guys can compare installed package lists easily and
help narrow it down?  There's a lot of optional stuff in
public-inbox since we try to support some old systems and users
who don't want extra dependencies; but yes, it gets difficult to
support so many possible combinations.

> Could you provide some help?

Hope the above was helpful, in any case I should be around-ish
the next few days.