From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp2 ([2001:41d0:2:bcc0::]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id gBc/AajZimBvTgAAgWs5BA (envelope-from ) for ; Thu, 29 Apr 2021 18:07:04 +0200 Received: from aspmx1.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp2 with LMTPS id OKdWOKfZimA4KAAAB5/wlQ (envelope-from ) for ; Thu, 29 Apr 2021 16:07:03 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 92693251A9 for ; Thu, 29 Apr 2021 18:07:03 +0200 (CEST) Received: from localhost ([::1]:37146 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1lc9Bu-0004dH-46 for larch@yhetil.org; Thu, 29 Apr 2021 12:07:02 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:41564) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lc982-0001q7-0w for guix-devel@gnu.org; Thu, 29 Apr 2021 12:03:02 -0400 Received: from mout01.posteo.de ([185.67.36.65]:58149) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lc97y-0003na-9l for guix-devel@gnu.org; Thu, 29 Apr 2021 12:03:01 -0400 Received: from submission (posteo.de [89.146.220.130]) by mout01.posteo.de (Postfix) with ESMTPS id A5A4424002B for ; Thu, 29 Apr 2021 18:02:55 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=posteo.net; s=2017; t=1619712175; bh=2J0JlxN4o+2y+VEfHvyq1F1vm0cqdurpnY4R9zHKLpY=; h=Date:From:To:Cc:Subject:From; b=ZmOSCiHMkMEJhdnSCxs7TC3eLe0qS/W+GNLtyRo1yhljVAhfcLrBDOHhYM8rbhOdm G17xXPIAY/V+oYF930Z4snEEjouKneSY2rZCYga9IAJHXpYBBB9MDVenQ1l0bWbse2 yKUhPM+U98b/IGRBXxVbIABw383+pI9O9rxGE03Iw0aAq8AZSgF/lX+E/+slm66BA5 RWznXgCdDZ01ku1xclPTrqrqsdPIankTacsjIeh3NErEVhqqYj0QFEtqhoMMqtpZrO KDuVkZi39ZpwggSqh2DBPPE9OFdgxMxGs6GICQIw/X8FTiB0BEv0DtDB4o2nb4SBDs MsuL/eRmBOHRg== Received: from customer (localhost [127.0.0.1]) by submission (posteo.de) with ESMTPSA id 4FWKz26R7vz9rxM; Thu, 29 Apr 2021 18:02:54 +0200 (CEST) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit Date: Thu, 29 Apr 2021 16:02:54 +0000 From: lubrito@posteo.net To: Christopher Baines Subject: Re: Outreachy: Timeline tasks References: <20210428145941.4bd0dd6f@lubrito> <87y2d2e0j4.fsf@cbaines.net> <20210428162030.2cab4106@lubrito> <87v986dvrn.fsf@cbaines.net> Message-ID: mid:1 Received-SPF: pass client-ip=185.67.36.65; envelope-from=lubrito@posteo.net; helo=mout01.posteo.de X-Spam_score_int: -37 X-Spam_score: -3.8 X-Spam_bar: --- X-Spam_report: (-3.8 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, INVALID_MSGID=0.568, MSGID_SHORT=0.001, RCVD_IN_DNSWL_MED=-2.3, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: guix-devel@gnu.org Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1619712423; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: references:references:list-id:list-help:list-unsubscribe: list-subscribe:list-post:dkim-signature; bh=tPnjzYYCUXmti+OfOCLG32OrwmaSMzKz5ADp9i8IHzE=; b=AsnzcJwJaLYilhXL8qQaPnygTd8iNyWEEZ9VaMqwHML1+82PyvXneKz1nXIUqgwmYuxVDT Xbmq7NHC0yS34nZc21owca+a1fqg+PT+casyNy4P1dESdV6ka0g8bOYqAZmS1FE5D0n9DF oGxMOSi3I5f4hvrn+F10R48M/cHrJUZl6ILnoAi1X6ghIDtR3sdVCML511bNk9Gvo6qtnq 9RYcWEF1uqHxUV9DL+Ard/B4U7trTwFJc5gDTt4JtsB2vuN5iVO2TM0hehVPPJ9hy1d0Fm jtpoUx8zW6GxHvbV10MBFx4TcRT/1tvbgniWFPXpBW1j0o2pkjezWVwSOdbsQQ== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1619712423; a=rsa-sha256; cv=none; b=iZHnT0YeJgamVmA9AWf7huHXUwFASeMRfL57kxbCsHHVB0Kc5vFxuJDLXRR/bPGpME7aMl A05Xq1dCRJyeMBNd8qSYLCVqD0m8QoNX7dw2VR841V2dWXLqI0kUcOjUZ2OF2dB1HML2tm gRpgvg9iCYMS0vMyHG+7IA0Tmj6GzowTwYBcEC3X+9dvUiJHSLtBRH06z5ThPZCXkLW6kc z3eKzEbdE8WB8F9eIZKOISpl/UpBPiFTJjZsmdvFeFMV3uAicRiwkx4/CdP3xbY5GWiGEe /x4bW1iC29tvMk7V2vTnz3YV04f2khKStneDmmVuKc0yyJddKNuq9sBGww9WIw== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=posteo.net header.s=2017 header.b=ZmOSCiHM; dmarc=pass (policy=none) header.from=posteo.net; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Migadu-Spam-Score: -0.96 Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=posteo.net header.s=2017 header.b=ZmOSCiHM; dmarc=pass (policy=none) header.from=posteo.net; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Migadu-Queue-Id: 92693251A9 X-Spam-Score: -0.96 X-Migadu-Scanner: scn0.migadu.com X-TUID: ifFBzoSnMSGG Hi, On Wed, 28 Apr 2021 21:00:44 +0100 Christopher Baines wrote: > I think time is the main thing, since that alone will help to identify > which are the slow parts. > Indeed, simplicity is a good thing to keep in mind. I'll keep in mind what you have said, so here are some ideas to break the tasks. Task 1: Add instrumentation to identify the slow parts of processing new revisions - Implementing a chart over time to identify slow parts; - Select candidate parts to be analyzed; - Should this part really be taking all this time? - Identify if the delay is caused by the code itself or by a query. - Prepare a document organizing where each part should be improved. Task 2: Improve the performance of these slow parts - implementing each improvements. This Task 2 is really difficult for me to divide in smaller tasks, I'm really stuck with ideas. I took a look at one of the logs as you told me, and I found this parts taking a considerable time: - Computing the channel derivations 636s - Acquiring advisory transaction lock: loading-new-guix-revision-inserts 2534s * - Getting derivation lint warnings 975s - fetching inferior lint warnings 1488s - Acquiring advisory transaction lock: loading-new-guix-revision-inserts 3226s * - Querying the temp-package-metadata 1949s - Fetching inferior package metadata 2476s To pick this parts is what should be facilitated by the chart? So I would perform the analysis of the task 1 and then the ta By the way, I noticed that the ones I marked with * are performed twice. Why is that? -- Best Regards, Luciana Lima Brito MSc. in Computer Science