From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp1.migadu.com ([2001:41d0:303:e16b::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms13.migadu.com with LMTPS id +LYjGWXUJGcQVgEA62LTzQ:P1 (envelope-from ) for ; Fri, 01 Nov 2024 13:15:17 +0000 Received: from aspmx1.migadu.com ([2001:41d0:303:e16b::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp1.migadu.com with LMTPS id +LYjGWXUJGcQVgEA62LTzQ (envelope-from ) for ; Fri, 01 Nov 2024 14:15:17 +0100 X-Envelope-To: larch@yhetil.org Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=worcester.edu header.s=google header.b=CObrypu4; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org"; dmarc=pass (policy=none) header.from=worcester.edu ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1730466917; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=U6QQxAXI7B4KQUGIxSX25FROlT9tuBXTIH/hKgtJdlg=; b=V11YseFv/IHEVHqKa/GtRgrGKtaftQ2OcVpNwY3xiMfdBa8YVlM14LAZ6GZXU21Ot2x+I+ 8ly7Q7wz6Hjm+uyEYs+/TEn/RzZs9c/CWKTggOFIGcbR89r3ycVpg3H718+5vhDclcBrhQ TzyS6hC89JYnLYpFY9yoiSNQ/levhjLmDbFBjy1XFa+H94G3wow2Exg8B/dQPXLX7+4oxo QMH45zWwU9ATkgg3ZVKrJRargYsc2Fqsaaj4JAi5hnAzZlgM11hBhGaQUkvczozIcCXt0O rxmfOP4XSR5oS/NcI2Qpi7wLC5FilTt2TYzUQ+Fl6qm0ubn4Ep/Ub3L9Jl61Yw== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1730466917; a=rsa-sha256; cv=none; b=FhZFELAdDdEBxeh0ORzKSMdWC2eGiXf2755+rSq6bYELgLVdzZJ7GYgOjO1U1YK1teGiRE 9vtAqgPkrzaXMxycWeVjFns9lHLPiaxk5xA4Zg4qrSoPA63AZiBOzLD/+cQxTOx9iGemAC 6yyCzxdbJFcm7Tsze5wKX1rDTD0R5rSgLrrS0TPIDaWg00AP55TEqnlVapByFYz0jP7Tke FYdrQmnc5GkeHvKoHD7xZOsDg/odw94XewHRLdEj8+IhiL9JiHGVzEqeHoGrHiQLXNbgEE PHLqe1GqcnDiPFngd8JWFZwgrBWvpSjNTk1+XPAafKnMX8Nz5vxoq8rfmuOHdg== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=worcester.edu header.s=google header.b=CObrypu4; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org"; dmarc=pass (policy=none) header.from=worcester.edu Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id EFECF6B71 for ; Fri, 01 Nov 2024 14:15:15 +0100 (CET) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1t6rU6-000424-54; Fri, 01 Nov 2024 09:14:38 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1t6rU4-00041l-TO for guix-devel@gnu.org; Fri, 01 Nov 2024 09:14:36 -0400 Received: from mail-qt1-x835.google.com ([2607:f8b0:4864:20::835]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1t6rU3-0005Ag-2r for guix-devel@gnu.org; Fri, 01 Nov 2024 09:14:36 -0400 Received: by mail-qt1-x835.google.com with SMTP id d75a77b69052e-4609beb631aso13056181cf.2 for ; Fri, 01 Nov 2024 06:14:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=worcester.edu; s=google; t=1730466874; x=1731071674; darn=gnu.org; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=U6QQxAXI7B4KQUGIxSX25FROlT9tuBXTIH/hKgtJdlg=; b=CObrypu4iMHAUkbZnNTOwHqG5loTD8T277fv/Nv4/qsfabq/T8X0mivuTD7/UxqR6K SNQZdL92UsApY1Dn5VnMrO6+crXJIsSQuh6PxKYMTlt3SLoRHYl70AM23lClrEDSH6EK dVqLDuxgrc/nH5GVHNkOdjEJ/QwsqVbRcuBiU= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1730466874; x=1731071674; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=U6QQxAXI7B4KQUGIxSX25FROlT9tuBXTIH/hKgtJdlg=; b=ZZPh0MzzrYsCMEj7IFjVoW4xeq+85+pcIBfcJP1zrJDz/uR7R6JnaQW2ZV8zvls0r8 NVedNXgLszM64JgziM8qU8e2X3axmzkdFvRPMOugLQ9uwgf30OW+dwI4qEUo8aWpN0Gw JPG2qHrjCQ8CNo4Ihy+X9GEg3zNuMtJuqaQ1kxTqkMNnFbaPznlHfF1eSFrZ04L0cAjo G5DIP/d1cqM41FoesTlWRl9U+HdM+3HMY1BL8BNhvwaTTbazM/t93SPoEpg8A1cUxacI fU93ASxRt/qK1vTvq6wYZYgsdh4L34moZae/xd4GzxnmwpaeCfIzwFuhUk6LlU178NRE fWBQ== X-Gm-Message-State: AOJu0YySYEq1cmzfeTTmBZytIFfN88t5Ucag2byTotUXFcvj/ofHWLnf TFgU8KuwUTOeyNPfYiKhapAOTpqXD71MTBqF/2LWrF0EPqWmdD4dN3K2ubfykSdNy6KL4XGdzvy ZtvSkJboF3noqH7avBh4QglOTFZ99kUlDlRk7ZrJw5bpDYEww X-Google-Smtp-Source: AGHT+IE5C6EdQZ2XkbeIx0wcmxwInJWq3FZgnt2iuoCTT2v08KX64bu8CBHdhfJ11MJhQ4MChpKwQstu0fM1JuNWGtc= X-Received: by 2002:ac8:5815:0:b0:461:68d5:6a83 with SMTP id d75a77b69052e-462b867ffefmr42396371cf.17.1730466873764; Fri, 01 Nov 2024 06:14:33 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: "Thompson, David" Date: Fri, 1 Nov 2024 09:14:22 -0400 Message-ID: Subject: Re: Possible useful guix package performance data To: Evan Cooney Cc: guix-devel Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Received-SPF: pass client-ip=2607:f8b0:4864:20::835; envelope-from=dthompson2@worcester.edu; helo=mail-qt1-x835.google.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: guix-devel-bounces+larch=yhetil.org@gnu.org X-Migadu-Flow: FLOW_IN X-Migadu-Country: US X-Migadu-Spam-Score: -4.16 X-Spam-Score: -4.16 X-Migadu-Queue-Id: EFECF6B71 X-Migadu-Scanner: mx13.migadu.com X-TUID: JMnU5pZLmgrV Hi Evan, On Fri, Nov 1, 2024 at 2:28=E2=80=AFAM Evan Cooney = wrote: > > Hi everyone, I used guile's statprof profiler to collect some performance= data for guix package. I added the profiler by using the statprof module i= n guix/guix/scripts/package.scm and wrapping the call to guix-package* in t= he guix package define command thing in a lambda, then in statprof. Here is= the code: paste.debian.net/1334168 > I collected this data by running guix package -i krita inkscape rust-rust= up-toolchain. It uses a significant amount of time in the garbage collector= (~75% of total runtime) and ~45% of time is spend calling append. What do = y'all make of this? Here is the full data: paste.debian.net/1334174 What are you trying to measure, exactly? The data collected is about a single thread of a Guile process, but `guix package -i` involves interaction with the Guix build daemon, waiting for downloads, etc. These things are outside the scope of what statprof is tracing. Anything that involves reaching out to the internet is going to make for an unreliable benchmark. I'm not actively working on Guix tools but I don't see anything immediately actionable from the collected data. I think getting some more clarity around the goal is necessary in order to know what to profile and how. - Dave