From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id 8GYdE/5t3V8zHAAA0tVLHw (envelope-from ) for ; Sat, 19 Dec 2020 03:05:34 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0 with LMTPS id +JjnDv5t3V+jNAAA1q6Kng (envelope-from ) for ; Sat, 19 Dec 2020 03:05:34 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 9C075940367 for ; Sat, 19 Dec 2020 03:05:33 +0000 (UTC) Received: from localhost ([::1]:43760 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kqSYm-0000Th-6u for larch@yhetil.org; Fri, 18 Dec 2020 22:05:32 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:52610) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kqSYN-0000T9-1e for bug-guix@gnu.org; Fri, 18 Dec 2020 22:05:07 -0500 Received: from debbugs.gnu.org ([209.51.188.43]:57309) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1kqSYI-0002kj-QU for bug-guix@gnu.org; Fri, 18 Dec 2020 22:05:05 -0500 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1kqSYI-0005Qh-KC for bug-guix@gnu.org; Fri, 18 Dec 2020 22:05:02 -0500 X-Loop: help-debbugs@gnu.org Subject: bug#30290: guix-daemon slows to a crawl when a substitute server is offline Resent-From: Maxim Cournoyer Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Sat, 19 Dec 2020 03:05:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 30290 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: zimoun Received: via spool by 30290-submit@debbugs.gnu.org id=B30290.160834705520809 (code B ref 30290); Sat, 19 Dec 2020 03:05:02 +0000 Received: (at 30290) by debbugs.gnu.org; 19 Dec 2020 03:04:15 +0000 Received: from localhost ([127.0.0.1]:40622 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kqSXX-0005PZ-89 for submit@debbugs.gnu.org; Fri, 18 Dec 2020 22:04:15 -0500 Received: from mail-qk1-f172.google.com ([209.85.222.172]:45970) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kqSXV-0005PN-Iz for 30290@debbugs.gnu.org; Fri, 18 Dec 2020 22:04:13 -0500 Received: by mail-qk1-f172.google.com with SMTP id b64so4071706qkc.12 for <30290@debbugs.gnu.org>; Fri, 18 Dec 2020 19:04:13 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:references:date:in-reply-to:message-id :user-agent:mime-version; bh=SfZypc43K7mTAIIrdWyT6DElSlzUe31ihGZjRuTTcxI=; b=jxNmILHa+G9gZRGX4LeHD363xfqGua+HZj30VmRFElRexy+r6/YmswORqxGqXjDEds dYbuOorvBTbQ9wa4nucoFlyrTl+kSLObigXwo5+x0HlkH/KHltsezRQ+ZTkJcgNnMOiK xGVkGlG8h+8/r4PSJ7Q/0Osr4XV2Q5Eun7hJPxtHH9V6nDthnFOEV8SByfNjeYrIYfdR u1JfmcKeunYizFlcaPvnKEHZaprl8scruAMfvM6JLdIOBy1E4Jwb9khcpVEjN7yEFwVv K2BQCrQ/gwIFOeAT+6Mmg41rKWF/OL/Ryl4dvcVUzoafLdVPOQ137kDWUSZcmqc47Kgi 8POg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:references:date:in-reply-to :message-id:user-agent:mime-version; bh=SfZypc43K7mTAIIrdWyT6DElSlzUe31ihGZjRuTTcxI=; b=JcukoQ6/te10m8IHjehP3yL6WrWdJ6cwGgcf6QMI7nSWLHNOqb4dUYkKNc0KQEVtnl ToFdQmlfUGqA9AoFTTkBbPkH5fdBK0wM5bnVWKIH79vOXIFejYXs7ZHCTt21hdILk83K WjmVV3G+cCF3VwCqFp/EaQruoilBNakUC1fb5rAyCYmsW3ocepUZZAFZ9+famPTlyBOQ 09iFFhbN9el7iJTu179hMy6v8wRpnyM/TJ4qcoO2gqFJbQzsqhUZiAvyorpcYiVupXEM phCOtLca0toFNKqt/ypiSRMaRxdUZcGtP1Ye+He4fMrOxIpEzY8wVjLVHbHhoTBiNb3c urEg== X-Gm-Message-State: AOAM532b1ZplwjJ4i+sn4lpwGwz4BIqO4k9X6B/HdSK21Vs+26vFV/gf SZEUJNYWncoxnzmk7N/szJEI50IZJwHAgsR2 X-Google-Smtp-Source: ABdhPJzQeAR+CswnDBj1KZvJNhQ8SO26JNFA8kIVqx98NoLm45IKXQbRVYO11kUQeIwxjuqEvjv59A== X-Received: by 2002:a37:b083:: with SMTP id z125mr8171132qke.246.1608347048051; Fri, 18 Dec 2020 19:04:08 -0800 (PST) Received: from hurd (dsl-10-146-235.b2b2c.ca. [72.10.146.235]) by smtp.gmail.com with ESMTPSA id b12sm6500486qtj.12.2020.12.18.19.04.07 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 18 Dec 2020 19:04:07 -0800 (PST) From: Maxim Cournoyer References: <87fu6o2ge2.fsf@gmail.com> <86mtyvzqo8.fsf@gmail.com> Date: Fri, 18 Dec 2020 22:04:04 -0500 In-Reply-To: <86mtyvzqo8.fsf@gmail.com> (zimoun's message of "Thu, 03 Dec 2020 01:20:07 +0100") Message-ID: <87h7oiebtn.fsf@gmail.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-guix@gnu.org List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: 30290@debbugs.gnu.org Errors-To: bug-guix-bounces+larch=yhetil.org@gnu.org Sender: "bug-Guix" X-Migadu-Flow: FLOW_IN X-Migadu-Spam-Score: -1.22 Authentication-Results: aspmx1.migadu.com; dkim=fail (headers rsa verify failed) header.d=gmail.com header.s=20161025 header.b=jxNmILHa; dmarc=fail reason="SPF not aligned (relaxed)" header.from=gmail.com (policy=none); spf=pass (aspmx1.migadu.com: domain of bug-guix-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=bug-guix-bounces@gnu.org X-Migadu-Queue-Id: 9C075940367 X-Spam-Score: -1.22 X-Migadu-Scanner: scn0.migadu.com X-TUID: Hx2RUn6ZLdYl Hi! zimoun writes: > Hi Maxim, > > On Mon, 29 Jan 2018 at 22:07, Maxim Cournoyer wrote: >> When a substitute server used by guix-daemon is offline, the daemon will >> keep attempting to connect to it, even when it shouldn't need any data >> (ran 'sudo guix system reconfigure my-config.scm' multiple times in a >> row. >> >> With the disconnected server (bayfront in my case), that command would >> take close to 8 minutes, with many system calls like: >> >> connect(14, {sa_family=AF_INET, sin_port=htons(443), sin_addr=inet_addr("141.255.128.56")}, 16) = -1 EINPROGRESS >> >> which wasted 5 seconds each time. >> >> After removing this server from my substitute servers list, the same >> operation (system reconfigure) is 8 times faster (1 minute). >> >> Suggestion: the daemon should stop trying to use the offline substitute >> server after trying for X times, and print a warning about it. > > This looks like as a wishlist, right? Do it make sense to include such > feature to the recent discussions about the revamp of offloading, > Cuirass, publish, etc. To me it's an issue more than a feature request, especially in a build farm setting; having a substitute machine down shouldn't cause a slow down for as long as it's down! I'm not sure if the recent offloading work that Mathieu did touched that topic. I'd need to test the scenario. Perhaps a system test would be useful. Maxim