From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp1 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id Zf6fEkfqe18FZwAA0tVLHw (envelope-from ) for ; Tue, 06 Oct 2020 03:53:43 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp1 with LMTPS id 0NXdDUfqe19JBwAAbx9fmQ (envelope-from ) for ; Tue, 06 Oct 2020 03:53:43 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 6507E9402DD for ; Tue, 6 Oct 2020 03:53:42 +0000 (UTC) Received: from localhost ([::1]:33928 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kPe2l-0002yd-TV for larch@yhetil.org; Mon, 05 Oct 2020 23:53:39 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:33826) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kPduQ-0001Dl-JP for bug-guix@gnu.org; Mon, 05 Oct 2020 23:45:02 -0400 Received: from debbugs.gnu.org ([209.51.188.43]:39471) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1kPduQ-0000Q4-9C for bug-guix@gnu.org; Mon, 05 Oct 2020 23:45:02 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1kPduQ-0000NO-6q for bug-guix@gnu.org; Mon, 05 Oct 2020 23:45:02 -0400 X-Loop: help-debbugs@gnu.org Subject: bug#43773: guix offload scheduler/load balancer throttles itself Resent-From: Maxim Cournoyer Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Tue, 06 Oct 2020 03:45:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 43773 X-GNU-PR-Package: guix X-GNU-PR-Keywords: patch To: zimoun Received: via spool by 43773-submit@debbugs.gnu.org id=B43773.16019558741388 (code B ref 43773); Tue, 06 Oct 2020 03:45:02 +0000 Received: (at 43773) by debbugs.gnu.org; 6 Oct 2020 03:44:34 +0000 Received: from localhost ([127.0.0.1]:51017 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kPdtx-0000MK-PV for submit@debbugs.gnu.org; Mon, 05 Oct 2020 23:44:33 -0400 Received: from mail-qk1-f170.google.com ([209.85.222.170]:41569) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kPdtw-0000M8-Hi for 43773@debbugs.gnu.org; Mon, 05 Oct 2020 23:44:33 -0400 Received: by mail-qk1-f170.google.com with SMTP id b69so8648394qkg.8 for <43773@debbugs.gnu.org>; Mon, 05 Oct 2020 20:44:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:references:date:in-reply-to:message-id :user-agent:mime-version; bh=07wq6swliklSrtA+lTOABndIRnkTrPV2g9PX8EVxtvo=; b=a9FQKToS2k83mkncdAYO8PwUD4MbeiQPA4dx/zaJ+G2fxWTlNttVJ9+NQp0ucH/Z8b wupHsF/FyoFQkHWmTUDp7S5Yb5/8Nnqwu+CD+0S+4YflZAs/RiUgzG8NZOFwHwX4au9H o0mBCtKV3SrPcEjcMBGcb4+rZQttJqLjQbKC2bGyznM++TPQm/902BTBGpJX8uGHybyX HFWCIzjgsEZJHoaMhOcApekEfbrYLLRcCfxGqf6OhUoN7XiMYtEisRrPkxt3dp1O/sui tnyynK1051P4VXmlUUZfE6+YG8cC6ou8c6WodMmlLhNXcP4BcGgReh5HpctUv7UskHlm GEbQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:references:date:in-reply-to :message-id:user-agent:mime-version; bh=07wq6swliklSrtA+lTOABndIRnkTrPV2g9PX8EVxtvo=; b=PiitJFGeGHwk9VK/93K+FkFuBzUz5a2oU8mBtqWm6CuqrTrVrt/KJJQpfnWqbuuKwL 6ft7ZYX0AQGhy7IsHneaXoCJy9dUPDHUuFJX2qFdY8OlinkRwdfpAWW9R2pHU/bc1rWx WKFNBBW3JkRL6Ako6Oa/vCyBvEGmqJ0dECj3mm7kKGbzV5JX3J+Uj68AWtEzpmiIeO7I zihtSHhpoMw8LnSB86rsobd+yVOfovAMSm16Eqm+RluW+VD49BtL+TZvEQ4SO1sZ6qFC YVAmRdv7Z2w1JhZST+OOaklkdjBiKbFrQaykFqh1IcHcos4bnQBG7dyjGsGg5SsxMmMd kq4A== X-Gm-Message-State: AOAM533zWk0I8GkVJHKPRnxQ9B7bVQTiImsbKwFDsBxuvrR/UHJOEf01 MM5gVGB0PSyyBj5KUulK5sFfhOLuRbp3cQ== X-Google-Smtp-Source: ABdhPJyIjY+2EpQzQrJSB4q/ydMHhHNUytsj24ha7pxvkfiUt1LDyXwVURmNoN1LY/lBRYPQzVwcmA== X-Received: by 2002:a37:7c3:: with SMTP id 186mr704884qkh.417.1601955866649; Mon, 05 Oct 2020 20:44:26 -0700 (PDT) Received: from hurd (dsl-10-141-84.b2b2c.ca. [72.10.141.84]) by smtp.gmail.com with ESMTPSA id k22sm1593777qkk.13.2020.10.05.20.44.25 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 05 Oct 2020 20:44:25 -0700 (PDT) From: Maxim Cournoyer References: <875z7sm2kv.fsf@gmail.com> Date: Mon, 05 Oct 2020 23:44:24 -0400 In-Reply-To: (zimoun's message of "Mon, 5 Oct 2020 23:00:35 +0200") Message-ID: <87imbohvc7.fsf@gmail.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: 0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-Spam-Score: -1.0 (-) X-BeenThere: bug-guix@gnu.org List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: 43773@debbugs.gnu.org Errors-To: bug-guix-bounces+larch=yhetil.org@gnu.org Sender: "bug-Guix" X-Scanner: scn0 Authentication-Results: aspmx1.migadu.com; dkim=fail (rsa verify failed) header.d=gmail.com header.s=20161025 header.b=a9FQKToS; dmarc=fail reason="SPF not aligned (relaxed)" header.from=gmail.com (policy=none); spf=pass (aspmx1.migadu.com: domain of bug-guix-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=bug-guix-bounces@gnu.org X-Spam-Score: 1.59 X-TUID: yLE9Xro9eVNo Hi, zimoun writes: > Hi Maxim, > > On Sat, 3 Oct 2020 at 05:04, Maxim Cournoyer wrote: > >> Idea of an improvement: it should choose the offload machine with the >> less load (already the case, I believe), and not block waiting for the >> load to go down before starting a build. > > I have never looked at this: schedule an offloading strategy. And for > example, I do not even know what is the current one. However, is it > not reinventing the wheel? I mean, there are "well-know" job > schedulers dealing with various constraints that we could > "reimplement" instead of trying "ours". Well, my remark is fully > naive, I do not know. :-) I tried to get inspiration from Jenkins's sources, but I failed to locate it. The patch posted here ended up fixing the normalized load and making it configurable. It reuses the existing (very simple) scheduling scheme. I've summarily documented it in the patch if you are curious. Maxim