all messages for Emacs-related lists mirrored at yhetil.org
 help / color / mirror / code / Atom feed
From: Eli Zaretskii <eliz@gnu.org>
To: phillip.lord@russet.org.uk (Phillip Lord)
Cc: johnw@gnu.org, emacs-devel@gnu.org
Subject: Re: An Emacs benchmarking suite
Date: Mon, 14 May 2018 19:18:48 +0300	[thread overview]
Message-ID: <83a7t2ky6v.fsf@gnu.org> (raw)
In-Reply-To: <87a7t21na2.fsf@russet.org.uk> (phillip.lord@russet.org.uk)

> From: phillip.lord@russet.org.uk (Phillip Lord)
> Cc: "Siraphob \(Ben\) Phipathananunth" <siraben@disroot.org>,  johnw@gnu.org,  emacs-devel@gnu.org
> Date: Mon, 14 May 2018 12:37:09 +0100
> 
> > Performance should indeed compare several versions n the same system.
> 
> 
> I wonder if there is a way to work out a base line value. Benchmarks
> could then look for multiples of this.

But such a base line would also have to be specific to a platform and
a given set of build options.

> So, something like time to create a big list (for CPU), and time to read
> a defined file (for IO). Then you could say "this file should parse in
> 1x IO base-line + 10x CPU base-line.

You assume a linear scalability, but that is not necessarily so.  The
ratio between performance indices of different codes could vary
depending on the build option and the underlying OS.

Btw, IME I/O is mostly negligible in Emacs applications, and generally
is not interesting for the issue at hand.  Only CPU is important, and
maybe also memory usage.



  reply	other threads:[~2018-05-14 16:18 UTC|newest]

Thread overview: 21+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2018-05-06  1:44 An idea, now that we have dynamic loading John Wiegley
2018-05-06  2:25 ` Óscar Fuentes
2018-05-10 12:45 ` Siraphob (Ben) Phipathananunth
2018-05-10 20:31   ` John Wiegley
2018-05-11  6:11     ` Eli Zaretskii
2018-05-11  7:56       ` John Wiegley
2018-05-11 14:59       ` Siraphob (Ben) Phipathananunth
2018-05-11 15:02         ` Eli Zaretskii
2018-05-11 15:22           ` An Emacs benchmarking suite (was: An idea, now that we have dynamic loading) Siraphob (Ben) Phipathananunth
2018-05-11 17:38             ` Eli Zaretskii
2018-05-14 11:37               ` An Emacs benchmarking suite Phillip Lord
2018-05-14 16:18                 ` Eli Zaretskii [this message]
2018-05-14 16:30                   ` Stefan Monnier
2018-05-15 13:24                     ` Phillip Lord
2018-05-10 13:58 ` An idea, now that we have dynamic loading Tom Tromey
2018-05-10 20:31   ` John Wiegley
2018-05-14 21:44     ` Tom Tromey
2018-05-14 23:36       ` John Wiegley
2018-05-21 21:13         ` Tom Tromey
2018-05-22  3:23           ` John Wiegley
2018-05-22  4:20             ` Tom Tromey

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=83a7t2ky6v.fsf@gnu.org \
    --to=eliz@gnu.org \
    --cc=emacs-devel@gnu.org \
    --cc=johnw@gnu.org \
    --cc=phillip.lord@russet.org.uk \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
Code repositories for project(s) associated with this external index

	https://git.savannah.gnu.org/cgit/emacs.git
	https://git.savannah.gnu.org/cgit/emacs/org-mode.git

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.