From mboxrd@z Thu Jan 1 00:00:00 1970 From: Vagrant Cascadian Subject: bug#40650: guix test suite failures building Debian package Date: Thu, 16 Apr 2020 10:23:57 -0700 Message-ID: <87o8rr1h02.fsf@ponder> References: <87pnc8wgnq.fsf@yucca> <87d087kem6.fsf@gnu.org> Mime-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" Return-path: Received: from eggs.gnu.org ([2001:470:142:3::10]:37283) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jP8GB-0001D7-Fa for bug-guix@gnu.org; Thu, 16 Apr 2020 13:25:09 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1jP8G6-0007RQ-RC for bug-guix@gnu.org; Thu, 16 Apr 2020 13:25:07 -0400 Received: from debbugs.gnu.org ([209.51.188.43]:55989) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1jP8G6-0007R5-Bw for bug-guix@gnu.org; Thu, 16 Apr 2020 13:25:02 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1jP8G6-0007x1-7K for bug-guix@gnu.org; Thu, 16 Apr 2020 13:25:02 -0400 Sender: "Debbugs-submit" Resent-Message-ID: In-Reply-To: <87d087kem6.fsf@gnu.org> List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-guix-bounces+gcggb-bug-guix=m.gmane-mx.org@gnu.org Sender: "bug-Guix" To: Ludovic =?UTF-8?Q?Court=C3=A8s?= Cc: 40650@debbugs.gnu.org --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Thanks for the quick response! On 2020-04-16, Ludovic Court=C3=A8s wrote: > Vagrant Cascadian skribis: > >> Any of the test suites that require networking will need to be disabled >> for Debian packages. > > That should be fine. Well, they need to be disabled even if networking is available... We might be able to make some of them "autopackagetests" ... e.g. tests that are run as part of Debian's CI infrastructure on the installed packages (as opposed to tests run from within the source tree). >> test-name: wrap-program, one input, multiple calls >> location: /build/guix-jgTHmh/guix-1.1.0/tests/build-utils.scm:94 >> source: >> + (test-equal >> + "wrap-program, one input, multiple calls" >> + "hello world\n" >> + (call-with-temporary-directory >> + (lambda (directory) >> + (let ((bash (search-bootstrap-binary >> + "bash" >> + (%current-system))) >> + (foo (string-append directory "/foo"))) >> + (call-with-output-file >> + foo >> + (lambda (p) >> + (format >> + p >> + "#!~a~%echo \"${GUIX_FOO} ${GUIX_BAR}\"~%" >> + bash))) >> + (chmod foo 511) >> + (with-environment-variable >> + "PATH" >> + (dirname bash) >> + (wrap-program foo `("GUIX_FOO" prefix ("hello"))) >> + (wrap-program foo `("GUIX_BAR" prefix ("world"))) >> + (unsetenv "LOCPATH") >> + (let* ((pipe (open-input-pipe foo)) >> + (str (get-string-all pipe))) >> + (with-directory-excursion >> + directory >> + (for-each delete-file '("foo" ".foo-real"))) >> + (and (zero? (close-pipe pipe)) str))))))) >> expected-value: "hello world\n" >> actual-value: #f >> actual-error: >> + (system-error >> + "copy-file" >> + "~A: ~S" >> + ("Permission denied" >> + "/build/guix-jgTHmh/guix-1.1.0/gnu/packages/bootstrap/i686-linux/ba= sh") >> + (13)) >> result: FAIL > > Here=E2=80=99s it=E2=80=99s =E2=80=98search-bootstrap-binary=E2=80=99 fro= m (guix tests) that tries to > create the file above, having downloaded it earlier. > > For the =E2=80=98guix=E2=80=99 package in Guix, what we do is that this a= nd related > files are inputs to the package; that way, they are not downloaded at > all upon =E2=80=98make check=E2=80=99 since they=E2=80=99re already there. > > All you need is to ensure that > gnu/packages/bootstrap/*-linux/{bash,mkdir,tar,xz} exist, are > executable, and are statically-linked. You could provide Debian > binaries if that=E2=80=99s more appropriate. Regarding providing Debian binaries, I could Build-Depend (the debian equivalent of "inputs") on bash-static and symlink to that, and maybe use busybox-static and symlinks for mkdir and tar, but I don't think there's a static implementation of xz in Debian. Do they strictly need to be statically linked? These are just for test suites, not actually used in the eventual packaged guix? I notice it's also checking for i686-linux/bash above even though the build was done on amd64/x86_64 ... and it would be non-trivial to enable cross-architecture checks for all architectures across all of Debian's architectures. >> test-name: channel-instances->manifest >> location: /build/guix-jgTHmh/guix-1.1.0/tests/channels.scm:177 > > [...] > >> + Initialized empty Git repository in /tmp/guix-directory= .kYfBE0/.git/ >> >> *** Please tell me who you are. >> >> Run >> >> git config --global user.email "you@example.com" >> git config --global user.name "Your Name" >> >> to set your account's default identity. >> Omit --global to set the identity only in this repository. >> >> fatal: unable to auto-detect email address (got 'vagrant@yucca.(none)') > > We may need to provide a dummy .gitconfig file or something here so we > can run these tests. See also . > (The same applies to several test failures.) > > Thoughts? I could try a couple things ... basically re-implement the patch from #37679 in Debian's packaging (e.g. HOME=3D/some/path and populate $HOME/.gitconfig), or apply the patch and try it. :) >> test-name: scandir*, properties >> location: /build/guix-jgTHmh/guix-1.1.0/tests/syscalls.scm:257 >> source: >> + (test-assert >> + "scandir*, properties" >> + (let ((directory >> + (dirname >> + (search-path %load-path "guix/base32.scm")))) >> + (every (lambda (entry name) >> + (match entry >> + ((name2 . properties) >> + (and (string=3D? name2 name) >> + (let* ((full (string-append directory "/" na= me)) >> + (stat (lstat full)) >> + (inode (assoc-ref properties 'inode)) >> + (type (assoc-ref properties 'type))) >> + (and (=3D inode (stat:ino stat)) >> + (or (eq? type 'unknown) >> + (eq? type (stat:type stat))))))))) >> + (scandir* directory) >> + (scandir directory (const #t) string> actual-value: #f >> result: FAIL > > Could you wrap the =E2=80=98scandir*=E2=80=99 and =E2=80=98scandir=E2=80= =99 calls in =E2=80=98pk=E2=80=99, run: like this? (pk (scandir* directory)) (pk (scandir directory (const #t) string make check TESTS=3Dtests/syscalls.scm > > and send =E2=80=98test-suite.log=E2=80=99? It's a bit expensive for me to do a build for just this test, but I can patch it and it should still get included in the full test-suite.log, yes? I guess it might make sense to do a build from a chroot manually to debug some of these test suite issues, but I usually just do a full package build to make sure I didn't manually tweak something without remembering what it was later... >> ++ guix build guile-gcrypt --with-branch=3Dguile-gcrypt=3Dmaster -d >> accepted connection from pid 17231, user vagrant >> updating checkout of 'https://notabug.org/cwebber/guile-gcrypt.git'... >> guix build: error: cannot fetch branch 'master' from https://notabug.org= /cwebber/guile-gcrypt.git: the SSL certificate is invalid: 0x08 - The certi= ficate is not correctly signed by the trusted CA >> + latest_drv=3D >> FAIL tests/guix-build-branch.sh (exit status: 1) > > This test relies on network access + HTTPS certificates. It does check > for the former but not the latter. Any suggestions on how to do that? This might be a candidate for "autopackagetests" described earlier. Alternately/Additionally, ship or create a git repository from the source tree, run git daemon on a random free port, and try it there. live well, vagrant --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iHUEARYKAB0WIQRlgHNhO/zFx+LkXUXcUY/If5cWqgUCXpiUsAAKCRDcUY/If5cW qjBeAQDzHV1o5h1XhwNWTPu3GewgJgF+Du2ZWRGAvBWaF68jFAEAwgTegNPR+rU9 rv7TT05OTM+qiCfEI8KZ3uN2pKbhSwQ= =064n -----END PGP SIGNATURE----- --=-=-=--