From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp12.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms9.migadu.com with LMTPS id qDGJKSb3bWRjPAEASxT56A (envelope-from ) for ; Wed, 24 May 2023 13:38:14 +0200 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp12.migadu.com with LMTPS id SE0KKSb3bWRjhQAAauVa8A (envelope-from ) for ; Wed, 24 May 2023 13:38:14 +0200 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 695A07F1E for ; Wed, 24 May 2023 13:38:14 +0200 (CEST) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1q1mog-0002tA-TM; Wed, 24 May 2023 07:38:06 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1q1mod-0002mb-1X for bug-guix@gnu.org; Wed, 24 May 2023 07:38:03 -0400 Received: from debbugs.gnu.org ([209.51.188.43]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1q1moc-00040V-G1 for bug-guix@gnu.org; Wed, 24 May 2023 07:38:02 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1q1moc-0001gD-AH for bug-guix@gnu.org; Wed, 24 May 2023 07:38:02 -0400 X-Loop: help-debbugs@gnu.org Subject: bug#63198: End-to-end tests Was: bug#63198: cups-service-type uses PAM-enabled 'cups' by default which prevents authentication Resent-From: muradm Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Wed, 24 May 2023 11:38:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 63198 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Csepp Cc: rekado@elephly.net, 63198@debbugs.gnu.org, maxim.cournoyer@gmail.com X-Debbugs-Original-Cc: Ricardo Wurmus , 63198@debbugs.gnu.org, bug-guix@gnu.org, Maxim Cournoyer Received: via spool by 63198-submit@debbugs.gnu.org id=B63198.16849282506400 (code B ref 63198); Wed, 24 May 2023 11:38:02 +0000 Received: (at 63198) by debbugs.gnu.org; 24 May 2023 11:37:30 +0000 Received: from localhost ([127.0.0.1]:42300 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1q1mo6-0001fA-Fb for submit@debbugs.gnu.org; Wed, 24 May 2023 07:37:30 -0400 Received: from nomad-cl1.muradm.net ([139.162.159.157]:33522) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1q1mo1-0001eq-2q for 63198@debbugs.gnu.org; Wed, 24 May 2023 07:37:28 -0400 Received: from localhost ([127.0.0.1]:37126) by nomad-cl1.muradm.net with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from ) id 1q1mnn-0004BX-1T; Wed, 24 May 2023 11:37:11 +0000 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=muradm.net; s=mail; h=Content-Type:MIME-Version:Message-ID:In-reply-to:Date:Subject:Cc:To :From:References:Sender:Reply-To:Content-Transfer-Encoding:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=QhSk6OuPnm1+NClEHQ456x8g13m5elBXNVP5cWJ3nuQ=; b=pGFk8M+KYWyshbuTD5xN5YeZGR 5owkw3d5vU4RoJapy9oYsHf2/a8HAQNpXvyWUyyjAD/tVIbJ77B6UVx4bDdDgXDje5CkGVoqlcjCM EwsQxaS+co42yOdpHwUHsc/EyA91AW5l4tTERJMldpVcBdLbBsNaF63u12qfV0/GUxFZbyZzX+Tm9 QT/9Z/ZbTA0fxNBF03lZwX0DEPQnovC+ZjM1l81wik92DwKygcHluzn7ArUmIfrnWYYXLXl3jkRQ7 i2H68WLoLY3UMTphjnCaISzGRQVa/+8PluOubQqFTpoFT1aC0YrZiFtr34CRloGLaPWh26oH9ELtX wibMdgWH+obxU7Q44uUYoFkFzC/amWNFFRhmTznLCTffYejCVk6x6w/JT2hv28iYAlP+KO2mxZnuu f5QObnA2uPAb3SOQnrHWl4hfA0rCLavT9QbCAy5rMkoWg2VZ4QMMCU96I1u+y1H7ic3q0iUQ/VBar vrNPbil2lG2wciouzA7VPsea; Received: from muradm by localhost with local (Exim 4.96) (envelope-from ) id 1q1mnr-0007Tx-2R; Wed, 24 May 2023 14:37:15 +0300 References: <87wn1s695u.fsf@gmail.com> <87v8giitdp.fsf@elephly.net> <87wn0youe0.fsf@riseup.net> User-agent: mu4e 1.10.2; emacs 30.0.50 From: muradm Date: Wed, 24 May 2023 14:28:26 +0300 In-reply-to: <87wn0youe0.fsf@riseup.net> Message-ID: <87edn67yfo.fsf@muradm.net> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha256; protocol="application/pgp-signature" X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-guix@gnu.org List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-guix-bounces+larch=yhetil.org@gnu.org Sender: bug-guix-bounces+larch=yhetil.org@gnu.org X-Migadu-Flow: FLOW_IN X-Migadu-Country: US ARC-Seal: i=1; s=key1; d=yhetil.org; t=1684928294; a=rsa-sha256; cv=none; b=EH2vDw/zuXyWB6gJn+/K3k4M5h69CG5Zf/hA45gtYjq9Vgulyjt551f1wO2DGKDldIErl4 9NXyAY5evMpHP1+UYA9rxL8RHKKL+N2+kI0Kc5F1dKmv/p0/eT9dBiXjZjoaKPw5ghkFiv s2bQ1VfeGbGhL0yrdVD/sk63AjtdmS/Jqi3Gn4CTiKJKrh0rsLW91a7jv4iJWtiKmPFQsQ 4tbk6DkKeQfJSkMrtebj15JykUKMR71+zvskFYYHVZg/Db0pH5cDLD8EiH9uEVsHyZCivn 3kc8Kj2CiFcI+JUjRe4wlSLEQTizNmYc3SJeXF2EAsxTaQmzicCjxGY4bTFN7Q== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=muradm.net header.s=mail header.b=pGFk8M+K; dmarc=fail reason="SPF not aligned (relaxed)" header.from=muradm.net (policy=none); spf=pass (aspmx1.migadu.com: domain of "bug-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="bug-guix-bounces+larch=yhetil.org@gnu.org" ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1684928294; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:resent-cc:resent-from:resent-sender: resent-message-id:in-reply-to:in-reply-to:references:references: list-id:list-help:list-unsubscribe:list-subscribe:list-post: dkim-signature; bh=QhSk6OuPnm1+NClEHQ456x8g13m5elBXNVP5cWJ3nuQ=; b=a7u70lSYKOmWqUK6Cs3gfEGa+6789kyBn7nGmrR71IiOFnlqO+FIJRdhD40tavA6Qm18aZ t+c8C4B3kHocTaVl950J4nf7Hl93zL1/T0u+69OXmcaldG8uxnNMhQXc4D6oJVnggOuP7N OZkEr/YGvMmH7NOUILu1UDnpUWGOBhp61hCVA2sfk0hqkYEhQsmGGoUO2pRLYeSzrhJK36 0AruBvI3aDWxcySjFQqC1wqHgC8pPWPHxbvHERhcP5X03QYhIZNai0wvGaL9Qvc5hTSOyM b40p0VsqQFqyctUCwalU6el7UOrQFaZS4yYbEAg2dYNmud7rNtvgIgef6WH5tA== X-Migadu-Scanner: scn1.migadu.com Authentication-Results: aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=muradm.net header.s=mail header.b=pGFk8M+K; dmarc=fail reason="SPF not aligned (relaxed)" header.from=muradm.net (policy=none); spf=pass (aspmx1.migadu.com: domain of "bug-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="bug-guix-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: 5.23 X-Spam-Score: 5.23 X-Migadu-Queue-Id: 695A07F1E X-TUID: DuZrGWsp0oYG --=-=-= Content-Type: text/plain; format=flowed Csepp writes: > Ricardo Wurmus writes: > > It might be a good idea to have more end-to-end tests in Guix > that would > check if common operations like "finding a printer" work. It's > quite a > bit of up-front effort, but it's better than relying on manual > testing > and could make things smoother in the long run. > SUSE has a cool testing framework based on screen captures, > maybe it > could be adapted to Guix? There is already test framework within Guix. You may find information at: https://guix.gnu.org/manual/en/guix.html#Running-the-Test-Suite In short, there are unit tests and system tests which can be found at gnu/tests/*.scm for inspiration. It is just a matter of time/resource availability to write tests. For cups specifically, you may not need screen capture processing or similar. It should be enough to use CLI tools available out of the box. muradm --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEESPY5lma9A9l5HGLP6M7O0mLOBeIFAmRt9usACgkQ6M7O0mLO BeKndhAAhZG9N0uvImwQSfSak5TGeuwQLLy7sKX/VpK18RoP/rCk3AwYv+69WSyE fBvDaIqAYMmVy+hYl3S3JEtzTjOkUIfo0cIMN7NfhlLzYbRhVwHMY+HEnEGdR9qx 0sP6CDE8VFuvdhE2iDub0nEIxy3tmX0DK2E+MRjXPFAsUPlifli0t3dLnAsroJ5x C4dW4YzvDFfb5RRNVN9gZxSFlJfIRHgoixxJTCCrvadOkLUSuzTRn47TPw+IAIJP 0hhteVLl4e2YYtYuA5hGciTBmx5Kwp32BYKjVJezmmNs2SIBVRD06RZkkwvAfhES 3QEjMqu6U0iWsgu3cYrHDmyz69V11yE0ugA71dUvg34qDUMeKkTsXDFVxI2vS8i+ I7ExcJHLZrpq8pMs89USaPaz8n4+p8AKWxRd4CTF8g93d0AnjRkUsCc0vBzHYCRr 7BXZE7e2TJF1yOFw5iZgatZU7RxvdW4tAUp9QYnNa4yJgaZaWkJlQQmQlOPODTNS rPpjaoezCyF+ydSDcrCNTfV28OrbvT55jcdB12p3/DwxY/F6UXbZOVZWO8nwppwi 9FhLz1MV15BQrforNmRB0Jx7peJJRIbX7F5Zv+mmYWTKTZ2qOZQE42fDrNskMwZK KivYsHrMFD4QQR0yyIZ3/NgAYU/RXDG0kojg877lvjgpOH4QPVw= =s29/ -----END PGP SIGNATURE----- --=-=-=--