From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([2001:470:142:3::10]:48115) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1j4APY-0004Ld-0i for guix-patches@gnu.org; Tue, 18 Feb 2020 16:28:13 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1j4APS-0000Wk-Rr for guix-patches@gnu.org; Tue, 18 Feb 2020 16:28:07 -0500 Received: from debbugs.gnu.org ([209.51.188.43]:35391) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1j4APS-0000WC-NR for guix-patches@gnu.org; Tue, 18 Feb 2020 16:28:02 -0500 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1j4APS-0004sy-Ir for guix-patches@gnu.org; Tue, 18 Feb 2020 16:28:02 -0500 Subject: [bug#37305] Making system installation tests faster Resent-Message-ID: From: Maxim Cournoyer References: <87sgpby4p9.fsf@gmail.com> <87y2yg3t3s.fsf@gnu.org> <87k14sfaz7.fsf@gmail.com> <87lfp6b5cs.fsf_-_@gmail.com> <8736bdf5il.fsf@gnu.org> <87blpzozz7.fsf@gmail.com> <8736ba3hxo.fsf_-_@gnu.org> <87sgj8j9sf.fsf@gmail.com> Date: Tue, 18 Feb 2020 16:27:25 -0500 In-Reply-To: <87sgj8j9sf.fsf@gmail.com> (Maxim Cournoyer's message of "Tue, 18 Feb 2020 08:37:52 -0500") Message-ID: <87sgj7wpqa.fsf@gmail.com> MIME-Version: 1.0 Content-Type: text/plain List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-patches-bounces+kyle=kyleam.com@gnu.org Sender: "Guix-patches" To: Ludovic =?UTF-8?Q?Court=C3=A8s?= Cc: 37305@debbugs.gnu.org Hello Ludovic! I have more benchmark results. Not to be compared with the previous results, as these were executed on a much faster machine (24 cores vs 4 cores), with an SSD instead of a rotative disk. Commands used: current-guix/pre-built: --8<---------------cut here---------------start------------->8--- time ./pre-inst-env guix system build -e \ '(begin (use-modules (gnu packages package-management)) (parameterize ((current-guix-package (current-guix/pre-built))) ((@@ (gnu tests install) operating-system-with-current-guix) (@@ (gnu tests install) %btrfs-root-os))))' --8<---------------cut here---------------end--------------->8--- current-guix (old fashionned): --8<---------------cut here---------------start------------->8--- time ./pre-inst-env guix system build -e \ '(begin (use-modules (gnu packages package-management)) (parameterize ((current-guix-package (current-guix))) ((@@ (gnu tests install) operating-system-with-current-guix) (@@ (gnu tests install) %btrfs-root-os))))' --8<---------------cut here---------------end--------------->8--- new current-guix (guix self): --8<---------------cut here---------------start------------->8--- time ./pre-inst-env guix system build -e \ '(begin (use-modules ((gnu ci) #:select (channel-instance->package)) (guix monads) (guix channels) (guix store) ((guix status) #:select (with-status-verbosity)) ((guix git-download) #:select (git-predicate)) (guix utils) (gnu packages package-management)) (with-store store (with-status-verbosity 2 (run-with-store store (mlet* %store-monad ((source-dir -> "/home/mcournoyer/src/guix") (source (interned-file source-dir "guix-source" #:recursive? #t #:select? (or (git-predicate source-dir) (const #t)))) (instance -> (checkout->channel-instance source)) (new-guix-current -> (channel-instance->package instance))) (return (parameterize ((current-guix-package new-guix-current)) ((@@ (gnu tests install) operating-system-with-current-guix) (@@ (gnu tests install) %btrfs-root-os)))))))))' --8<---------------cut here---------------end--------------->8--- Methodology: 1. Break at each commit of the current change set, run make, and run the three above commands in the order they appear. 2. Record the "real" component of the time results of each commit/command in the table below. | Commit | current-guix/pre-built | old current-guix | new current-guix | |--------------------------------------------------------------+------------------------+------------------+------------------| | linux-boot: Ensure volatile root is mounted read-only. | 2m2.245s | 13m39.669s | 3m47.066s | | file-systems: Add a 'file-system-device->string' procedure. | 2m12.576s | 13m42.906s | 3m43.212s | | gnu: linux-boot: Refactor boot-system. | 1m53.928s | 13m48.825s | 9m53.133s | | file-systems: Represent the file system options as an alist. | 2m12.530s | "" | 10m3.523s | | gnu: linux-boot: Honor the "--root-options" kernel argument. | "" | "" | 11m10.448s | | gnu: linux-boot: Filter out file system independent options. | "" | "" | 5m4.997s | | bootloader: grub: Allow booting from a Btrfs subvolume. | 2m13.375s | 13m44.671s | 3m38.815s | |--------------------------------------------------------------+------------------------+------------------+------------------| This machine appears to be 5 times faster (at this task) than the previous one used, to give an idea of the time someone would have to wait just to build the operating system to test. An x200 would be even slightly slower that than. One of the things that seems costly is rebuilding the documentation. Maxim