From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp2 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id wFbSNEWccV8CSgAA0tVLHw (envelope-from ) for ; Mon, 28 Sep 2020 08:18:13 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp2 with LMTPS id CJh1MEWccV8/KwAAB5/wlQ (envelope-from ) for ; Mon, 28 Sep 2020 08:18:13 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 2253D94042B for ; Mon, 28 Sep 2020 08:18:12 +0000 (UTC) Received: from localhost ([::1]:48300 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kMoMM-00073L-Ki for larch@yhetil.org; Mon, 28 Sep 2020 04:18:10 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:33728) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kMoME-00071O-9B for bug-guix@gnu.org; Mon, 28 Sep 2020 04:18:02 -0400 Received: from debbugs.gnu.org ([209.51.188.43]:39796) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1kMoMD-0003ld-Uy for bug-guix@gnu.org; Mon, 28 Sep 2020 04:18:01 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1kMoMD-00043f-RS for bug-guix@gnu.org; Mon, 28 Sep 2020 04:18:01 -0400 X-Loop: help-debbugs@gnu.org Subject: bug#43564: cuirass: Contention while registering new builds. Resent-From: Mathieu Othacehe Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Mon, 28 Sep 2020 08:18:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 43564 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: 43564@debbugs.gnu.org Received: via spool by 43564-submit@debbugs.gnu.org id=B43564.160128106315573 (code B ref 43564); Mon, 28 Sep 2020 08:18:01 +0000 Received: (at 43564) by debbugs.gnu.org; 28 Sep 2020 08:17:43 +0000 Received: from localhost ([127.0.0.1]:51342 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kMoLv-000437-89 for submit@debbugs.gnu.org; Mon, 28 Sep 2020 04:17:43 -0400 Received: from eggs.gnu.org ([209.51.188.92]:55018) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kMoLt-00042u-Nc for 43564@debbugs.gnu.org; Mon, 28 Sep 2020 04:17:41 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]:38882) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kMoLo-0003jj-Fh for 43564@debbugs.gnu.org; Mon, 28 Sep 2020 04:17:36 -0400 Received: from [2a01:e0a:19b:d9a0:d549:2a8f:de3b:c9c0] (port=33626 helo=cervin) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1kMoLo-0006nK-3b for 43564@debbugs.gnu.org; Mon, 28 Sep 2020 04:17:36 -0400 From: Mathieu Othacehe References: <87imc5zrc8.fsf@gnu.org> <87k0wee3ud.fsf@gnu.org> Date: Mon, 28 Sep 2020 10:17:34 +0200 In-Reply-To: <87k0wee3ud.fsf@gnu.org> (Mathieu Othacehe's message of "Mon, 28 Sep 2020 09:51:38 +0200") Message-ID: <87d026e2n5.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.3 (--) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-Spam-Score: -3.3 (---) X-BeenThere: bug-guix@gnu.org List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-guix-bounces+larch=yhetil.org@gnu.org Sender: "bug-Guix" X-Scanner: scn0 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of bug-guix-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=bug-guix-bounces@gnu.org X-Spam-Score: -1.51 X-TUID: +e0JZ6sR34QV For future reference, here's a small addition. As I said, we are using the Cuirass SQLite database in WAL mode. This means that insertion queries are added to a separate cuirass.db-wal file. Once in a while, this file is supposed to be merged in the main cuirass.db file. This mechanism known as checkpointing is supposed to occur automatically once 4MB of data are added to the WAL file. On berlin, the WAL file of Cuirass is 9.4M and the Guix WAL file is almost 1G. As reading from the WAL file is less effective, and checkpointing a large file will end-up locking the database for some times, we should definitely try to understand why the Guix WAL file get so big. Thanks, Mathieu