From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: =?utf-8?Q?Mattias_Engdeg=C3=A5rd?= Newsgroups: gmane.emacs.devel Subject: Re: master afc0bfd380: Speed up loaddefs-generate on slow disks Date: Sun, 5 Jun 2022 12:06:30 +0200 Message-ID: <04DA3B8A-8BC9-4D30-B827-8894C7DF513E@acm.org> References: <165416120601.23485.9799765950267646757@vcs2.savannah.gnu.org> <20220602091326.514E9C009A8@vcs2.savannah.gnu.org> <87a6avccs4.fsf@gnus.org> <871qw48vc8.fsf@gnus.org> Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.120.0.1.13\)) Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="20523"; mail-complaints-to="usenet@ciao.gmane.io" Cc: emacs-devel@gnu.org To: Lars Ingebrigtsen Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Sun Jun 05 12:09:00 2022 Return-path: Envelope-to: ged-emacs-devel@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1nxnBq-00057g-Sc for ged-emacs-devel@m.gmane-mx.org; Sun, 05 Jun 2022 12:08:59 +0200 Original-Received: from localhost ([::1]:49270 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1nxnBp-0004RL-GX for ged-emacs-devel@m.gmane-mx.org; Sun, 05 Jun 2022 06:08:57 -0400 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]:57916) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nxn9f-0002yV-IO for emacs-devel@gnu.org; Sun, 05 Jun 2022 06:06:47 -0400 Original-Received: from mail74c50.megamailservers.eu ([91.136.10.84]:45690 helo=mail92c50.megamailservers.eu) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nxn9a-00056n-GW for emacs-devel@gnu.org; Sun, 05 Jun 2022 06:06:42 -0400 X-Authenticated-User: mattiase@bredband.net DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=megamailservers.eu; s=maildub; t=1654423593; bh=wRvLl+3F+ramh9PfcQHz+F0ux4fm5oUTq8hXOWKjdyE=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From; b=Q6LpnBTzBKts4I/IUbaBlCW0CXHhj+/ySCRpk8mdRYro1C2JjCpgeb1+NUJZSm+1O YkmuAe8UXXshPdrg9gL0th55pfTOurxicelcOfFNpd5aahKpk62g7OphQ+0rNOF99Z KRUEGLeB6lUEJ1BYz0Q5u6O6t8zku01mKtjZr2lY= Feedback-ID: mattiase@acm.or Original-Received: from smtpclient.apple (c188-150-171-71.bredband.tele2.se [188.150.171.71]) (authenticated bits=0) by mail92c50.megamailservers.eu (8.14.9/8.13.1) with ESMTP id 255A6UiJ001796; Sun, 5 Jun 2022 10:06:32 +0000 In-Reply-To: <871qw48vc8.fsf@gnus.org> X-Mailer: Apple Mail (2.3654.120.0.1.13) X-CTCH-RefID: str=0001.0A742F25.629C8028.0057, ss=1, re=0.000, recu=0.000, reip=0.000, cl=1, cld=1, fgs=0 X-CTCH-VOD: Unknown X-CTCH-Spam: Unknown X-CTCH-Score: 0.000 X-CTCH-Flags: 0 X-CTCH-ScoreCust: 0.000 X-Origin-Country: SE Received-SPF: softfail client-ip=91.136.10.84; envelope-from=mattiase@acm.org; helo=mail92c50.megamailservers.eu X-Spam_score_int: -11 X-Spam_score: -1.2 X-Spam_bar: - X-Spam_report: (-1.2 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, SPF_HELO_NONE=0.001, SPF_SOFTFAIL=0.665, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=no autolearn_force=no X-Spam_action: no action X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Original-Sender: "Emacs-devel" Xref: news.gmane.io gmane.emacs.devel:290684 Archived-At: 4 juni 2022 kl. 14.30 skrev Lars Ingebrigtsen : > I ran this three times and picked the median build time for each date, > and viola: = https://quimby.gnus.org/circus/stats-emacs/build-times.html Thank you! I picked a few edges that looked like transitions to a higher = plateau and tried to find the culprit in the logs, but it's really hard. = There are many commits and nothing obvious stands out. Things that might make it easier (speculating here): * add commit hashes to the points in the graphs because Git dates are a = bit ambiguous: are they author or commit date, what time of day are we = talking about, what time zone, etc * higher resolutions for selected periods (requires more build runs). = Ideally one per commit but that would require vast amounts of time and = be very noisy (many botched builds), but perhaps one per day? I'm ashamed to admit that I looked for effects of my own attempts at = speeding things up, but they were so intermingled with other changes = that hard conclusions were difficult. (Mattias giveth, Alan taketh = away.) It would be very useful if we could have an automatic (or = semi-automatic) daily build monitoring performance like this, perhaps = even running benchmarks. Selecting good benchmarks is hard; the elisp-benchmarks in ELPA were = made by Andrea for his compilation efforts and are nigh-useless for = anything else, unfortunately. I've written my own suites but again they = are only useful for what measuring very specific aspects.