From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp2.migadu.com ([2001:41d0:403:4876::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms13.migadu.com with LMTPS id YAjXGnTjdWbeDgEAe85BDQ:P1 (envelope-from ) for ; Fri, 21 Jun 2024 20:32:52 +0000 Received: from aspmx1.migadu.com ([2001:41d0:403:4876::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp2.migadu.com with LMTPS id YAjXGnTjdWbeDgEAe85BDQ (envelope-from ) for ; Fri, 21 Jun 2024 22:32:52 +0200 X-Envelope-To: larch@yhetil.org Authentication-Results: aspmx1.migadu.com; none Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 5A38E75C91 for ; Fri, 21 Jun 2024 22:32:52 +0200 (CEST) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1sKkvi-0004w1-8G; Fri, 21 Jun 2024 16:32:18 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1sKkvg-0004vp-JH for guix-devel@gnu.org; Fri, 21 Jun 2024 16:32:16 -0400 Received: from sail-ipv4.us-core.com ([208.82.101.137]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_CHACHA20_POLY1305:256) (Exim 4.90_1) (envelope-from ) id 1sKkve-0006Af-I7 for guix-devel@gnu.org; Fri, 21 Jun 2024 16:32:16 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; s=2017; bh=fgrWrMZbWVn3ZIa N3KLXW6aZcxpSRBUg9JOAdPvHYsA=; h=date:references:in-reply-to:subject: to:from; d=lease-up.com; b=H74QBfB/MIXgSxRJhnGIdYpXnricH36LC4ADnlwubJH uDGmyck0Seyxl7pBEK46lUNoGm3wqU1jXZ/Y+DA3tZ5+E/NWJ97HmhydoQQ/mCkU5JN/Gz iqqioukKkvIJi9ImFOvxvlwY6//K00dgojNTwC5NoOE/M/1GDb/uBBvVuU= Received: by sail-ipv4.us-core.com (OpenSMTPD) with ESMTPSA id 7b0b9770 (TLSv1.3:TLS_CHACHA20_POLY1305_SHA256:256:NO); Fri, 21 Jun 2024 20:32:12 +0000 (UTC) To: maya@zenmaya.xyz, guix-devel@gnu.org Subject: Re: Debugging failing shepherd startup In-Reply-To: <87a5je77f8.fsf@zenmaya.xyz> References: <87a5je77f8.fsf@zenmaya.xyz> Date: Fri, 21 Jun 2024 13:32:12 -0700 Message-ID: <87y16yghpv.fsf@lease-up.com> MIME-Version: 1.0 Content-Type: text/plain Received-SPF: pass client-ip=208.82.101.137; envelope-from=felix.lechner@lease-up.com; helo=sail-ipv4.us-core.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-to: Felix Lechner From: Felix Lechner via "Development of GNU Guix and the GNU System distribution." Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: guix-devel-bounces+larch=yhetil.org@gnu.org X-Migadu-Country: US X-Migadu-Flow: FLOW_IN X-Spam-Score: -4.00 X-Migadu-Queue-Id: 5A38E75C91 X-Migadu-Scanner: mx10.migadu.com X-Migadu-Spam-Score: -4.00 X-TUID: NXF1GDntZPb9 Hi Maya, On Fri, Jun 21 2024, maya@zenmaya.xyz wrote: > From a certain update my system fails to boot. It successfully boots > into kernel and starts shepherd. But after that shepherd fails to > activate some necessary service and the system is softlocked. I have had the same problem repeatedly one one piece of equipment. It is vexing to the n-th degree. > My question is, is there a way to debug this? I mostly need help with > identifying the failing service, once I have it, I think I can sort it > out. I disable all suspect services and then add them back with an ad-hoc geometric algorithm: I add half and, if those works, add a quarter, and then an eighth... There is some disagreement one how the Shepherd can produce better logging output. Some information may be in /var/log/messages but it can be hard to find. You are not alone. Please post a reproducer if you have one. Kind regards Felix