From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp2.migadu.com ([2001:41d0:700:3204::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms8.migadu.com with LMTPS id aJkoK6QQd2WAMwAAkFu2QA (envelope-from ) for ; Mon, 11 Dec 2023 14:37:40 +0100 Received: from aspmx1.migadu.com ([2001:41d0:403:4876::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp2.migadu.com with LMTPS id mOCzI6QQd2WBmgAAe85BDQ (envelope-from ) for ; Mon, 11 Dec 2023 14:37:40 +0100 X-Envelope-To: larch@yhetil.org Authentication-Results: aspmx1.migadu.com; dkim=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org"; dmarc=none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1702301860; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:in-reply-to:in-reply-to: references:references:list-id:list-help:list-unsubscribe: list-subscribe:list-post; bh=oGcA2QOHf+GIgFej6N4qrwTEiAKnsAzlY7nCYU0x+lA=; b=TtjHvLk+OsVOlf+FE2Sok0EH0xAVbC2JjRAngKbfDh+/urXvsXoY9HxUDJWFh+GjJrbKK/ N31yT+/aHS7d0j10wSc6W9KoWiY3VAXpi3oV1u7Jf1sOKSj/L1I5QCNXvTkCckygey9yld GGXoDcwaGGzhXiIEAZSwrBadO2HkJtEG1ZS1ZQgx304Pc1Jlj66GK0aLewQp+UR4/xQJ8C gPCDroMc3bizB0ybplbgjqC4fWeTYWzTX34frVirWgRsI0rGcqrDEaSwv9UaZkVMA5G0Rf Ti76l5FCDVNZ3T7F8LkOUXl4SrwWSJ8Ey9oSN/WhtgERP4AUxMqBM6J2X2/l8g== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org"; dmarc=none ARC-Seal: i=1; s=key1; d=yhetil.org; t=1702301860; a=rsa-sha256; cv=none; b=X+dphr3kCfdJBOY2D6uSQ5EW8rCE8RDlsFzUMoicY6WeDn91voH6AOeU/KGXa/DAo7LkNM MFu/6zHy4I1P5wksv7kMCTCb2SkfYQOjwNYaKujYYrNxQNG//FSkDgXcaRxLxVu9vQn/Y/ UyRvRGaR0whX/bOx7nM8caETwIvbGytJ++0KrIUA30HNKiWP46y+vsw+5VLeFuOFflPMux p5Z+LRYLiXNg3RSu0aRy9uGHmeUuYszXRgAnvViG//TL+MuBzC9tqlDY/lWTpQm50XJC1Y YO/Ht5SRbF55Li4HipH/oHf6hPjZQtyVyg0BlSlSRXgWJFu1mfwzLwgAhvU8ug== Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 349DD20AFC for ; Mon, 11 Dec 2023 14:37:40 +0100 (CET) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1rCgT4-00032b-QW; Mon, 11 Dec 2023 08:37:06 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1rCgT2-000329-FP; Mon, 11 Dec 2023 08:37:04 -0500 Received: from mira.cbaines.net ([2a01:7e00:e000:2f8:fd4d:b5c7:13fb:3d27]) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1rCgSw-0003C1-Qf; Mon, 11 Dec 2023 08:37:03 -0500 Received: from localhost (unknown [217.155.61.229]) by mira.cbaines.net (Postfix) with ESMTPSA id 34E8427BBE2; Mon, 11 Dec 2023 13:36:53 +0000 (GMT) Received: from felis (localhost [127.0.0.1]) by localhost (OpenSMTPD) with ESMTP id 5465d3d9; Mon, 11 Dec 2023 13:36:52 +0000 (UTC) References: <87lea7jtlw.fsf@cbaines.net> <875y177iik.fsf@gnu.org> <87lea3zexr.fsf@cbaines.net> <87zfyj7a46.fsf@nckx> <87h6kqz5jq.fsf@cbaines.net> <87a5qidouw.fsf@gmail.com> User-agent: mu4e 1.10.7; emacs 29.1 From: Christopher Baines To: Maxim Cournoyer Cc: Tobias Geerinckx-Rice , Ludovic =?utf-8?Q?Court=C3=A8s?= , guix-devel@gnu.org, guix-europe-sac@gnu.org, guix-maintainers@gnu.org Subject: Re: Shutting down qa.guix? Date: Mon, 11 Dec 2023 13:30:24 +0000 In-reply-to: <87a5qidouw.fsf@gmail.com> Message-ID: <878r60zwr1.fsf@cbaines.net> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" Received-SPF: pass client-ip=2a01:7e00:e000:2f8:fd4d:b5c7:13fb:3d27; envelope-from=mail@cbaines.net; helo=mira.cbaines.net X-Spam_score_int: -18 X-Spam_score: -1.9 X-Spam_bar: - X-Spam_report: (-1.9 / 5.0 requ) BAYES_00=-1.9, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: guix-devel-bounces+larch=yhetil.org@gnu.org X-Migadu-Country: US X-Migadu-Flow: FLOW_IN X-Migadu-Spam-Score: -2.89 X-Spam-Score: -2.89 X-Migadu-Queue-Id: 349DD20AFC X-Migadu-Scanner: mx10.migadu.com X-TUID: p0eoHFp2/TM9 --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Maxim Cournoyer writes: > Hi, > > Christopher Baines writes: > >> Tobias Geerinckx-Rice writes: >> >>> Christopher Baines =E5=86=99=E9=81=93=EF=BC=9A >>>> it's not the most cost effective setup >>> >>> Has this been explained in more detail before? >> >> Probably not, beid is currently a CPX51 Hetzner cloud server costing >> =E2=82=AC65.33 a month. This has been useful as it's enabled scaling the >> resources dynamically, but it would be possible to reduce the costs and >> still have sufficient RAM/disk space by using a Hetzner server auction >> machine for example. >> >> It's not all about cost though, given the data service is one of the >> slow points of QA, if we want QA to get faster at giving feedback, it's >> probably important to not try and cut costs on this part of the system. > > Isn't QA mostly slow because of the lack of x86 build machines? Does > the head node needs to be powerful itself? What kind of resources does > it likes having the most? CPU? RAM? Storage? There are two key bottlenecks, processing the revisions in the data service, then the build coordinator performing the builds. For the data service, lots of RAM helps as computing and building the derivations for Guix (similar to pull, time-machine, ...) is quite expensive in CPU and RAM. Also computing all the derivations for each revision takes a lot of RAM. Storage is also an issue as beid currently is working with 340G of total storage and that's almost full, and this doesn't leave any space for maintenance. More storage means being able to store data about more patch series at once. For the build coordinator, the machine doesn't need to be powerful, it has quite low requirements. While bayfront's storage isn't particularly fast, it's more than sufficient in terms of hardware. More build machines, including x86 ones would speed up the test results for patches and branches though. --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQKlBAEBCgCPFiEEPonu50WOcg2XVOCyXiijOwuE9XcFAmV3EHJfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDNF ODlFRUU3NDU4RTcyMEQ5NzU0RTBCMjVFMjhBMzNCMEI4NEY1NzcRHG1haWxAY2Jh aW5lcy5uZXQACgkQXiijOwuE9XfVQw/+IrDPRQij+JfaIWVbxFsGXrnpzMUsRn8l et5JqzNaMYFUeUxHWAWYfgBy6vf/gbN8mo6ZbRRjNTBkIcT/Wfd8yrvfM/BBjSl0 gTgwfebNf//+M+qIxz/eZh/0DgFoCgX3FNyAZnYmpX2xLcfCyZqFp3DFX1xDKqTS mSuSPCuxiMIT89lJUHtdLc4dfG6acx34/V2VNo0biOpM9N5dIRbkEE8qmcHU+wMe wEBiA0EWFeKuqzsPOUuxZft+XiQwqZ9v3a2cdQxZ+60JdrHs1SS6gvenl0Ea/MEi m6KJUyRfyugQggGASk54TXBIUn+5eCLENm4cHDFEiRI6khrDQybUVd3LU1sB5nqr Ua+CRtHFN7kcOZ8MDjDILEHwko2qW7Dk52DAySgmXtF4NaY66+PA2+rtYeVfDwtO /yYM0V8FcWYgb9J6RzeaD7zQ+dNIFajMlN6K+l4C+CBVMDZorF+BGjHTAfVQ4gZL oebAHLAfH83w11vbDYFkpALIpZt9OBW00Vem1WMZIpwmtpoYV/bKfXONaj60/pss Mv57QBTG/UMF6To5cAcw2sudkIXqBz/ERkmzQrIVwMGdsy0dzEiqhkAUvucPA/La 7tBK2ZkoEbKbXhd1w+Rk+/OeOqQm2AlQGVOAWQsCj9b46Xz11nwjmZUBU5NKJpnS OMl+kaVgRlA= =oESH -----END PGP SIGNATURE----- --=-=-=--