From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp10.migadu.com ([2001:41d0:8:6d80::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms5.migadu.com with LMTPS id iGNuIyElUGPm0AAAbAwnHQ (envelope-from ) for ; Wed, 19 Oct 2022 18:26:09 +0200 Received: from aspmx1.migadu.com ([2001:41d0:8:6d80::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp10.migadu.com with LMTPS id 2CuJIiElUGNvRwEAG6o9tA (envelope-from ) for ; Wed, 19 Oct 2022 18:26:09 +0200 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 444F826461 for ; Wed, 19 Oct 2022 18:26:09 +0200 (CEST) Received: from localhost ([::1]:43198 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1olBtQ-00024o-Fn for larch@yhetil.org; Wed, 19 Oct 2022 12:26:08 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:51954) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1olBtK-0001z9-91 for bug-guix@gnu.org; Wed, 19 Oct 2022 12:26:02 -0400 Received: from debbugs.gnu.org ([209.51.188.43]:60785) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1olBtJ-00054D-Vd for bug-guix@gnu.org; Wed, 19 Oct 2022 12:26:01 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1olBtJ-0002Aj-Nq for bug-guix@gnu.org; Wed, 19 Oct 2022 12:26:01 -0400 X-Loop: help-debbugs@gnu.org Subject: bug#58631: Shepherd crash on berlin Resent-From: Ludovic =?UTF-8?Q?Court=C3=A8s?= Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Wed, 19 Oct 2022 16:26:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 58631 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: 58631@debbugs.gnu.org Received: via spool by 58631-submit@debbugs.gnu.org id=B58631.16661967088266 (code B ref 58631); Wed, 19 Oct 2022 16:26:01 +0000 Received: (at 58631) by debbugs.gnu.org; 19 Oct 2022 16:25:08 +0000 Received: from localhost ([127.0.0.1]:59856 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1olBsS-00029G-5B for submit@debbugs.gnu.org; Wed, 19 Oct 2022 12:25:08 -0400 Received: from eggs.gnu.org ([209.51.188.92]:58902) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1olBsM-00028e-Le for 58631@debbugs.gnu.org; Wed, 19 Oct 2022 12:25:06 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]:54100) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1olBsD-0004bl-Cc for 58631@debbugs.gnu.org; Wed, 19 Oct 2022 12:24:53 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:In-Reply-To:Date:References:Subject:To: From; bh=OtXQxU4jgTgYrc8HPsC849uxiq4u10/hyyfFYlPOuSs=; b=iyJ0apX8SKjYEnYF7/Bb F39nI8DggS6th0xybQmoGLhAFjompkBASjWAESdEsj1IhONEyJYAU/UEHKVod7Y6CdnEWBOtwiO4+ jNohFt5dq2AnDjRmVS9ZeqZiM+MnmahRS9GOqE3y99A1WJFm83Te3DntuQ8vBVSrN/FHPfPnLmBHB Av5DvPqSJQfkCht3ydw2sk0vv4XMsRLTs1cMNW0Z/x/NF0oGGQVQ8YSVWLD14ZpI4PFnNjvJO6w6T Ksj1Blo7iTsZlwwZV61hhSFKqXx85vydJPso32iSQwbd7r1EVcKZP+iMp53zg31Yp03rDZxE/NzLm /0ZoYdtqIchG2Q==; Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=51934 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1olBsB-0003LM-Up for 58631@debbugs.gnu.org; Wed, 19 Oct 2022 12:24:52 -0400 From: Ludovic =?UTF-8?Q?Court=C3=A8s?= References: <87pmeohute.fsf@gnu.org> Date: Wed, 19 Oct 2022 18:24:50 +0200 In-Reply-To: <87pmeohute.fsf@gnu.org> ("Ludovic =?UTF-8?Q?Court=C3=A8s?="'s message of "Wed, 19 Oct 2022 14:17:01 +0200") Message-ID: <87sfjjhjcd.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-guix@gnu.org List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-guix-bounces+larch=yhetil.org@gnu.org Sender: "bug-Guix" X-Migadu-Flow: FLOW_IN X-Migadu-Country: US ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1666196769; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding:resent-cc: resent-from:resent-sender:resent-message-id:in-reply-to:in-reply-to: references:references:list-id:list-help:list-unsubscribe: list-subscribe:list-post:dkim-signature; bh=OtXQxU4jgTgYrc8HPsC849uxiq4u10/hyyfFYlPOuSs=; b=eryK4Z6Ap9THG3nnbbdsKhs/OJpY4kDOuerE7kMtzqcr3yXnaJrYAw2lUBSlQhE85S+efy l57yZRHdnAfUyEyqO2ijhY2D83H1XTGih2akZNuOko89IWrFM7BrnVGXzhzmo+XmiVWE87 FqdSDipJW295mhd91AEz89PYdfVUlYtyMr4SI/E/FziAPeOlKsf4VzoVhEoBeUhMyG2ogZ b41CXHZwAJB6qyVomLfX6xE3yBXkUN/+62TKV3spB9K/H6IUqvo4lwBiQHXHEM6LHXn3T3 8GVtV0sWGMMXzODaCEx8D5xYN072V3zIvmvKqc1FconX54ItNi5t/i3hDPlTYA== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1666196769; a=rsa-sha256; cv=none; b=sOZV8JBUxsDsGTva7fLoIUIJbQmpHKMiBBsba1yX9WXD3cclJ2isCQl/0N6mmVWSYI089A 42GiclvmzO+WanJqxR3xc03WYt9onXR2Bgm2cXht9lT8pRRRuWSms3rlZba2AayHjA3y8R yYzywF/1XQmr5X4g4b6wbUtxxUR42/EUvneyyTh/BtzIklLLW/fqA0IGx5AavEbIsc1LBd 4EzbI/y0XDVBCy1yNzaV6iGzCvTEPToLqbpUGnhWW5e306v7zr3KhC4fVo9fGHa8pBy1ik 0rBq/cQrPc9U0gvzRGT6ogKSVU89I3qPS0AFmN/B9ERhXD1S7gUV9xRqVzGlPw== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=gnu.org header.s=fencepost-gnu-org header.b=iyJ0apX8; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of "bug-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="bug-guix-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: -2.33 Authentication-Results: aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=gnu.org header.s=fencepost-gnu-org header.b=iyJ0apX8; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of "bug-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="bug-guix-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: 444F826461 X-Spam-Score: -2.33 X-Migadu-Scanner: scn1.migadu.com X-TUID: LSE3TBGR+Z7o Same backtrace with debugging symbols for libgc and libc: --8<---------------cut here---------------start------------->8--- (gdb) bt #0 0x00007ff3018dc264 in ?? () from /gnu/store/cdc1gzbp3q15kdiwn2i5j3437jwx61ac-shepherd-0.9.2/lib/shep= herd/crash-handler.so #1 #2 0x00007ff3018dc264 in ?? () from /gnu/store/cdc1gzbp3q15kdiwn2i5j3437jwx61ac-shepherd-0.9.2/lib/shep= herd/crash-handler.so #3 #4 __GI_raise (sig=3Dsig@entry=3D6) at ../sysdeps/unix/sysv/linux/raise.c:= 49 #5 0x00007ff30b2bc526 in __GI_abort () at abort.c:79 #6 0x00007ff30b7bb263 in GC_add_to_heap (bytes=3D, p=3D0x7f= efd1f70000) at extra/../alloc.c:1232 #7 GC_expand_hp_inner (n=3Dn@entry=3D2048) at extra/../alloc.c:1386 #8 0x00007ff30b7c2232 in GC_collect_or_expand (needed_blocks=3Dneeded_bloc= ks@entry=3D1,=20 ignore_off_page=3Dignore_off_page@entry=3D0, retry=3Dretry@entry=3D0) a= t extra/../alloc.c:1480 #9 0x00007ff30b7c25a8 in GC_allocobj (gran=3Dgran@entry=3D7, kind=3D) at extra/../alloc.c:1543 #10 0x00007ff30b7c290f in GC_generic_malloc_inner (lb=3Dlb@entry=3D112, k= =3Dk@entry=3D1) at extra/../malloc.c:191 #11 0x00007ff30b7c78da in GC_generic_malloc_many (lb=3Dlb@entry=3D112, k=3D= k@entry=3D1,=20 result=3Dresult@entry=3D0x7ff30b246e48) at extra/../mallocx.c:473 #12 0x00007ff30b87fb45 in scm_inline_gc_alloc (kind=3DSCM_INLINE_GC_KIND_NO= RMAL, idx=3D6,=20 freelist=3D0x7ff30b246e48) at gc-inline.h:79 #13 allocate_words_with_freelist (thread=3D0x7ff30b246d80, freelist_idx=3D6= ) at intrinsics.c:470 #14 0x00007ff300039f95 in ?? () #15 0x00007ff30b246d80 in ?? () #16 0x00007ff302a2f7e8 in ?? () #17 0x0000000000000040 in ?? () #18 0x00007ff30b88bb1c in scm_jit_enter_mcode (thread=3Dthread@entry=3D0x7f= f30b246d80,=20 mcode=3D0x7ff30231e75c "B", ,=20 mcode@entry=3D0x7ff302a2f7e8 "I\211\314I)\304I\203\374 \017\205\345\b")= at jit.c:6038 #19 0x00007ff30b8e80c5 in scm_call_n (proc=3D, argv=3Dargv@e= ntry=3D0x7ffeae067878,=20 nargs=3Dnargs@entry=3D1) at vm.c:1602 #20 0x00007ff30b862ea7 in scm_primitive_eval (exp=3D) at eva= l.c:671 #21 0x00007ff30b88d729 in scm_primitive_load (filename=3D) a= t load.c:131 #22 0x00007ff30b8e5915 in vm_regular_engine (thread=3D0x7ff30b246d80) at vm= -engine.c:972 #23 0x00007ff30b8e8029 in scm_call_n (proc=3D, argv=3Dargv@e= ntry=3D0x7ffeae067a58,=20 nargs=3Dnargs@entry=3D1) at vm.c:1608 #24 0x00007ff30b862ea7 in scm_primitive_eval (exp=3D,=20 exp@entry=3D((@ (ice-9 control) %) (begin ((@@ (ice-9 command-line) loa= d/lang) "/gnu/store/cdc1gzbp3q15kdiwn2i5j3437jwx61ac-shepherd-0.9.2/bin/she= pherd") (quit)))) at eval.c:671 --8<---------------cut here---------------end--------------->8--- This means we=E2=80=99re hitting this =E2=80=98abort=E2=80=99 call: --8<---------------cut here---------------start------------->8--- GC_INNER void GC_add_to_heap(struct hblk *p, size_t bytes) { hdr * phdr; word endp; if (GC_n_heap_sects >=3D MAX_HEAP_SECTS) { ABORT("Too many heap sections: Increase MAXHINCR or MAX_HEAP_SECTS"= ); } --8<---------------cut here---------------end--------------->8--- Indeed, the core dump weighs 13=C2=A0GiB, so it looks like a memory leak (t= oo bad =E2=80=98info proc stat=E2=80=99 in GDB doesn=E2=80=99t work). I have not observed it on any other machine. The difference between berlin and machines I have access to is that berlin is being hammered on port 22, which means it gets to spawn sshd processes very often. This could be where the leak is. Ludo=E2=80=99.