From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp11.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms5.migadu.com with LMTPS id 2VphM53wjWPI9QAAbAwnHQ (envelope-from ) for ; Mon, 05 Dec 2022 14:22:37 +0100 Received: from aspmx1.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp11.migadu.com with LMTPS id mNKFMp3wjWM2KgEA9RJhRA (envelope-from ) for ; Mon, 05 Dec 2022 14:22:37 +0100 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 6BD7C3C146 for ; Mon, 5 Dec 2022 14:22:37 +0100 (CET) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1p2BQE-0008GW-12; Mon, 05 Dec 2022 08:22:14 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1p2BQ2-0008F6-I2 for bug-guix@gnu.org; Mon, 05 Dec 2022 08:22:12 -0500 Received: from debbugs.gnu.org ([209.51.188.43]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1p2BQ2-0007N0-9o for bug-guix@gnu.org; Mon, 05 Dec 2022 08:22:02 -0500 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1p2BQ2-0000pQ-4F for bug-guix@gnu.org; Mon, 05 Dec 2022 08:22:02 -0500 X-Loop: help-debbugs@gnu.org Subject: bug#48468: substitute server connection timeout Resent-From: Ludovic =?UTF-8?Q?Court=C3=A8s?= Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Mon, 05 Dec 2022 13:22:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 48468 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Mathieu Othacehe Cc: 48468@debbugs.gnu.org Received: via spool by 48468-submit@debbugs.gnu.org id=B48468.16702464963175 (code B ref 48468); Mon, 05 Dec 2022 13:22:02 +0000 Received: (at 48468) by debbugs.gnu.org; 5 Dec 2022 13:21:36 +0000 Received: from localhost ([127.0.0.1]:35994 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1p2BPc-0000p9-4z for submit@debbugs.gnu.org; Mon, 05 Dec 2022 08:21:36 -0500 Received: from eggs.gnu.org ([209.51.188.92]:42810) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1p2BPa-0000p3-M6 for 48468@debbugs.gnu.org; Mon, 05 Dec 2022 08:21:35 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1p2BPS-0007KC-PN for 48468@debbugs.gnu.org; Mon, 05 Dec 2022 08:21:29 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:In-Reply-To:Date:References:Subject:To: From; bh=QdgzazPdBaky6oWPFshw7JxEXLHN3x9Z1jEgar2OWp4=; b=Tq3PRLGnbvwXUXkn+Lk9 B5HPonNF5S2wASbMfDEfvPQUEYjRYcGs/Vb2UiTKVQVErsa4yeKa947UwMyAdKHYTaU6aUFRUjv8q 3lc1SYUgsZhpII9RmacW81iqvxh/3CQB0XrS1mipklFkd2P8v0hizfjcnhVjq7J/VzQ5cx4ID5Suq Pl+Ot0mHbAlFJ+4M/gHEWdW5TJpQtA4um4Gdow3HWzUzaiarW+PWfQ5ZH78ews2btAbkmYlIAhH1U mGgOT5B/0W2wFCaWAdlhv3XEq8uT/Ap1CARcP/lUF6LgrC939OUpe5z7+qWhAouyjr8CK3YnwJC6k HZWJ+mNW5gO9sw==; Received: from [2001:660:6102:320:e120:2c8f:8909:cdfe] (helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1p2BPR-0006qF-UV; Mon, 05 Dec 2022 08:21:26 -0500 From: Ludovic =?UTF-8?Q?Court=C3=A8s?= References: <87lf8e4l42.fsf@gnu.org> <87im2bfj3i.fsf@gnu.org> <87sg108vl5.fsf@gnu.org> Date: Mon, 05 Dec 2022 14:21:23 +0100 In-Reply-To: <87sg108vl5.fsf@gnu.org> (Mathieu Othacehe's message of "Tue, 29 Jun 2021 18:49:26 +0200") Message-ID: <87lenmrnos.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-guix@gnu.org List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-guix-bounces+larch=yhetil.org@gnu.org Sender: bug-guix-bounces+larch=yhetil.org@gnu.org X-Migadu-Flow: FLOW_IN X-Migadu-Country: US ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1670246557; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding:resent-cc: resent-from:resent-sender:resent-message-id:in-reply-to:in-reply-to: references:references:list-id:list-help:list-unsubscribe: list-subscribe:list-post:dkim-signature; bh=QdgzazPdBaky6oWPFshw7JxEXLHN3x9Z1jEgar2OWp4=; b=CqJDxMTV/nhSk4mFvDLy9DEYocjeMiQ3uq7XoWjYeyNOwhfjuMI2k1bPBbSPJ1EDl2fqU+ XlcBEFnRbwcG4UNEnGfsmao2N2ymoieG7C6cgy/VA4LGOx3BG+v4sBxqupzLLJwTtuzH9C 3Fl6szVoiHiQw9CGr9ax0hjg4The8K+oTHAqGTcfteqTSldm8ZoNJudIl6K3308DBvMT5W 7mkPM/O9aPqmVHTgAyiNbjY4FN+J8XgiZ78UL1sIrR091ZutjI1DTakCjOSNKDpXoLvvx8 0y4ak6DXG36ktPclhaf2ZW0v6NcxFSmVsBEXinX6b/2ywtqoLxq7wblq4j3tYQ== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1670246557; a=rsa-sha256; cv=none; b=k5Dly/wWtP6rjDb24Ol/qDJJti/Efr1H5fTh17Vwsazh4f/aeIq+CxG1fBhH3Ay0mq1sg5 QIiajyUuKwO3ghItsBdBwreCBaOUAYUs4vu3C8E9D0Ulg1rkv9xj8jEE8qcivcTg3ihpG3 CncqFGrTKwZGmX7KefwfNNFNFmY/AhDmCSpU2QWX8gj96weRIskEwHiKSq6+/vX1ACUpqF ANFPYM5UF5zA3I3trQyb/KDJ+vjwnIVpkkotD1BsDjb/WqHayLzHjBN2wb7IbIPvkIe3Zn tedlgYG0RbIlWciwOYCCvg7uy+AujbfFJjtF1F2h4ojfaNWw3rClNWPPU9rbcw== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=gnu.org header.s=fencepost-gnu-org header.b=Tq3PRLGn; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of "bug-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="bug-guix-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: -3.87 Authentication-Results: aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=gnu.org header.s=fencepost-gnu-org header.b=Tq3PRLGn; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of "bug-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="bug-guix-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: 6BD7C3C146 X-Spam-Score: -3.87 X-Migadu-Scanner: scn1.migadu.com X-TUID: fiL9h0DR097j Hi, Mathieu Othacehe skribis: > I hoped that it would decrease the load of the Cuirass publish server > that was flooded by worker connections. While the situation is better, > there are still a lot of substitute timeout errors on Cuirass. > > I have also observed those timeouts using the publish server behind > ci.guix.gnu.org. This makes me think that there's something else that is > preventing the server from honoring every connection request in less > than 5 seconds (the timeout duration). I don=E2=80=99t see this when substituting from https://ci.guix.gnu.org the= se days. You mentioned on IRC that nginx logs show that =E2=80=98guix publish=E2=80= =99 times out. Looking at /var/log/nginx/error.log, I see =E2=80=9CConnection reset by pee= r=E2=80=9D and =E2=80=9CBroken pipe=E2=80=9D, which could indicate that the client clo= sed the connection (which was open) prematurely, maybe due to an internal timeout. What I=E2=80=99d like to know is whether those timeouts you mention appear during connection establishment (connect(2) on the client side doesn=E2=80= =99t complete within 5 seconds) or after connection establishment. Connection establishment is handled by the kernel and =E2=80=98guix publish= =E2=80=99 is not involved. However, the listen(2) call made in (web server http) sets a maximum backlog of 128 connections; if at some point 128 connections are already queued, then the 129th client will have connect(2) take some time. Seems unlikely, but who knows. Ludo=E2=80=99.