From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp2.migadu.com ([2001:41d0:403:4876::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms8.migadu.com with LMTPS id uNOzKWs01WUSfgEAe85BDQ:P1 (envelope-from ) for ; Wed, 21 Feb 2024 00:23:23 +0100 Received: from aspmx1.migadu.com ([2001:41d0:403:4876::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp2.migadu.com with LMTPS id uNOzKWs01WUSfgEAe85BDQ (envelope-from ) for ; Wed, 21 Feb 2024 00:23:23 +0100 X-Envelope-To: larch@yhetil.org Authentication-Results: aspmx1.migadu.com; dkim=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org"; dmarc=none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1708471403; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:mime-version:mime-version: content-type:content-type:list-id:list-help:list-unsubscribe: list-subscribe:list-post; bh=dK+Sef8xwdazR6goKNYdq+VV1YiVcpIpzP0LPpDaHWI=; b=kyndw77HslCBuxxx15Wo5XRFxZD4/SCgL5y69Bc3k2iwKOMcPTlekYGVw58DkGR6beA+YG y0MWrHObk5XLN4v6tfnyTjjspXlDKWva5QrlRTdxXAfdSjGQt36FyIa5x8C6Vsc/AhzJSk 28cgfx3EHo5GJWEzlHf3Bu2hZSkrKhRisCdm18n9oWXGdzNCMuQR1BRqtWaSMhwkj2U6Gc tzGBcJ+U/iAX81ghlUPlr5Ft+F0JFRndJHkZE8y/Kfdk1fAwHwwPPuctrLQ7utU+4TJmHm S4QJUwiHjyWtzR+7D2oEky4qdWz1SgRv6i55Bi73P5LtgNOQX4FfcVuevezTMw== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org"; dmarc=none ARC-Seal: i=1; s=key1; d=yhetil.org; t=1708471403; a=rsa-sha256; cv=none; b=TqahMuYCB67FQXjt4fLQQ7afCd8AVKDtnrS0CW8MGElIabrKM/DYwfkoE1Hmuz6mhZ9Bfq aEZljs+qFh+lGpVb12ywllN1yjzwH80nATzRqkU1emBbgQRuc6xqzD7zujW09qnsaYZy7e u3RHTNSaTWvByuq0m93mBEwrGpaWkC+gLkomTvauJasOhhroMwcwE4j9ovPRaCw4PM235C Bfg4RGQr3OkKscOkcDSRzheHIXnOq4+nvI1+EFua4jyVV2JOg+to5R/2yZ9ORGcQ8DEuDe CUO5AqA4qVVpd7KEhDfZ97VofWKObXYFRNXzkxhwvHm3yApMzkvSUDRpqTFJeg== Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 37E727EF6D for ; Wed, 21 Feb 2024 00:23:23 +0100 (CET) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1rcZRe-0001D9-NI; Tue, 20 Feb 2024 18:22:38 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1rcZRd-0001Cj-Hf for guix-devel@gnu.org; Tue, 20 Feb 2024 18:22:37 -0500 Received: from mira.cbaines.net ([212.71.252.8]) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1rcZRb-0004oa-Nt for guix-devel@gnu.org; Tue, 20 Feb 2024 18:22:37 -0500 Received: from localhost (unknown [212.132.255.10]) by mira.cbaines.net (Postfix) with ESMTPSA id 5778D27BBE2 for ; Tue, 20 Feb 2024 23:22:34 +0000 (GMT) Received: from felis (localhost.lan [127.0.0.1]) by localhost (OpenSMTPD) with ESMTP id e29ec8e8 for ; Tue, 20 Feb 2024 23:22:33 +0000 (UTC) User-agent: mu4e 1.10.8; emacs 29.1 From: Christopher Baines To: guix-devel@gnu.org Subject: February update on the Guile guix-daemon Date: Tue, 20 Feb 2024 19:53:43 +0000 Message-ID: <87cysqn2ko.fsf@cbaines.net> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" Received-SPF: pass client-ip=212.71.252.8; envelope-from=mail@cbaines.net; helo=mira.cbaines.net X-Spam_score_int: -2 X-Spam_score: -0.3 X-Spam_bar: / X-Spam_report: (-0.3 / 5.0 requ) BAYES_00=-1.9, DATE_IN_PAST_03_06=1.592, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=no autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: guix-devel-bounces+larch=yhetil.org@gnu.org X-Migadu-Flow: FLOW_IN X-Migadu-Country: US X-Migadu-Scanner: mx10.migadu.com X-Migadu-Spam-Score: -6.21 X-Spam-Score: -6.21 X-Migadu-Queue-Id: 37E727EF6D X-TUID: a5btGw9yXt9c --=-=-= Content-Type: text/plain Hey! Here's an overdue update on rewriting the Guix daemon in Guile, following on from the earlier thread on guix-devel [1] and the blog post [2]. 1: https://lists.gnu.org/archive/html/guix-devel/2023-09/msg00328.html 2: https://guix.gnu.org/en/blog/2023/a-build-daemon-in-guile/ Unfortunately I was quite slow to actually get stuck in with the code. Among other things, I've been distracted by trying to at least work around long running issues with the build coordinator and data service. I wanted to try and get QA back up and running and reduce the number of times that manual intervention is required, and this has been successful to some extent. I'm going to try harder to focus on the guix-daemon in the coming months however. With the time I have managed to spend working on the daemon though, I think I've made some progress. I started by getting a process to listen on a socket, then worked through implementing operations used by guix build (with many simplifying assumptions that is). This has given me some assurances about the viability of the technical plan I outlined in the blog post, as well as filling in some of the details. These are my current thoughts about the work ahead: - I've sent a couple of patch series [3][4] to adapt parts of Guix for use in the daemon, there'll need to be more changes in the database and substitute areas though. - I'm starting to understand, test and adapt the work on the guile-daemon branch, but there's more that needs doing on this. - Then there's the big areas to work on next: - I think I'm going to need to use thread pools for SQLite operations in the daemon, as the build coordinator does. - There's the low level work of setting up the build environment, the work on the guile-daemon branch helps a lot with this, but as pointed out by Ludo, there might be some issues with fork and similar operations in a Guile program using threads. - While I've implemented some of the server side protocol used by the daemon, I'd like to extract that code in to a module so that it's not wrapped up inside the daemon script 3: https://issues.guix.gnu.org/69291 4: https://issues.guix.gnu.org/69292 I think once I've made more progress in the above areas, I will hopefully have something that people could attempt to use in a limited capacity. Let me know if you have any comments or questions, Thanks, Chris --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQKlBAEBCgCPFiEEPonu50WOcg2XVOCyXiijOwuE9XcFAmXVNDdfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDNF ODlFRUU3NDU4RTcyMEQ5NzU0RTBCMjVFMjhBMzNCMEI4NEY1NzcRHG1haWxAY2Jh aW5lcy5uZXQACgkQXiijOwuE9XeAyg//aLJ2qK3Pjc3qKIzjSuIKqOgHM6uAfzwm HhAxEw2nu92R3SqrhkOHXQyQqUjLkULymVpTbs5BVIZTpztkshPzlULHg052wTNE QN8wapN0xaZ6VJdCUeAoNc7oPxV2GmYC83bfVRa/1Eq3J38uvhwo7JfoJ24fN0Z7 MFLymJwKE6J9AX3VmOVhHMMQyh6CsE1tYJQahwqisSw8oIgFG8BO4t8zHk+SDcDV j5mompJfjGBq1++ymb8ffHUw5cie6eGNhFo8e7+VPKusUgOgXLklBEoQx1Lq3Uf7 myZ3ecXlW3OTrqKr2JintvLyiO5VvM537GGrRQIR3xYkNwpaz1DLGbZxQ3kAsHbV HTIIs26JEojJAJ+z9Y3fNW2fFna4oumXuJjnMqn6uXEwYmm1l6Iu5Aw8/8c0kW4T tKyDuR6tY1DrhwVOqMU3+faoAd359n2QnsYjA38QePAFA72MFW7YvaiXvkqoYW/E +loaUHDDo3PsLs+TTRGQ1VkWxN/DGiiW13fV18F76cx5rBLmsl32Pw7L3FD6gMgM 5ZDr/AxR0uZcP38CZKpUMv4knNLb3Kba7WqgSenKkrHOmJ40lTwjdtQe9v3tir7I PfZy2Vf92WxbWeLRsbkqE8jBYRVMEF7nirE3dThrfXe7Rx6U3A42sMiE4mDYxGsX 34Ej6BFBRPQ= =wl67 -----END PGP SIGNATURE----- --=-=-=--