[RFC] If you use Org 9.6, please share the output of M-x org-element-cache-hash-show-statistics

[RFC] If you use Org 9.6, please share the output of M-x org-element-cache-hash-show-statistics

[Ihor Radchenko]

Hi,

I would like to assess the efficiency of one of search optimizations used
in org-element.el [1]

The statistics about efficiency is collected by Org, but obviously not
shared without your consent.

If you are ok with sharing the statistics, and you are running Emacs
session for at least few hours (using Org mode, obviously), please reply
sharing the output of
 M-x org-element-cache-hash-show-statistics <RET>
 M-x emacs-uptime <RET>

[1] Pugh [Information Processing Letters] (1990) Slow optimally balanced
 search strategies vs. cached fast uniformly balanced search strategies.
 http://dx.doi.org/10.1016/0020-0190(90)90130-P

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>

Re: [RFC] If you use Org 9.6, please share the output of M-x org-element-cache-hash-show-statistics

[Hanno Perrey]

Hej Ihor,

below is the requested output. I spent most my time working in Org mode.

Best wishes,
Hanno


,----
| (org-element-cache-hash-show-statistics)
`----

,----
| 1.56% of cache searches hashed, 3.37% non-hashable.
`----


,----
| (org-version nil 't)
`----

,----
| Org mode version 9.6 (9.6-??-bed47b437 @ /home/hperrey/.emacs.d/.local/straight/build-28.1.91/org/)
`----


,----
| (emacs-uptime)
`----

,----
| 37 days, 5 hours, 20 minutes, 25 seconds
`----



Ihor Radchenko <yantar92@posteo.net> skrev: (9 februari 2023 12:51:49 CET)
>Hi,
>
>I would like to assess the efficiency of one of search optimizations used
>in org-element.el [1]
>
>The statistics about efficiency is collected by Org, but obviously not
>shared without your consent.
>
>If you are ok with sharing the statistics, and you are running Emacs
>session for at least few hours (using Org mode, obviously), please reply
>sharing the output of
> M-x org-element-cache-hash-show-statistics <RET>
> M-x emacs-uptime <RET>
>
>[1] Pugh [Information Processing Letters] (1990) Slow optimally balanced
> search strategies vs. cached fast uniformly balanced search strategies.
> http://dx.doi.org/10.1016/0020-0190(90)90130-P
>
>-- 
>Ihor Radchenko // yantar92,
>Org mode contributor,
>Learn more about Org mode at <https://orgmode.org/>.
>Support Org development at <https://liberapay.com/org-mode>,
>or support my work at <https://liberapay.com/yantar92>
>

Re: [RFC] If you use Org 9.6, please share the output of M-x org-element-cache-hash-show-statistics

[Mark Barton]

> On Feb 9, 2023, at 3:51 AM, Ihor Radchenko <yantar92@posteo.net> wrote:
> 
> Hi,
> 
> I would like to assess the efficiency of one of search optimizations used
> in org-element.el [1]
> 
> The statistics about efficiency is collected by Org, but obviously not
> shared without your consent.
> 
> If you are ok with sharing the statistics, and you are running Emacs
> session for at least few hours (using Org mode, obviously), please reply
> sharing the output of
> M-x org-element-cache-hash-show-statistics <RET>
> M-x emacs-uptime <RET>
> 
> [1] Pugh [Information Processing Letters] (1990) Slow optimally balanced
> search strategies vs. cached fast uniformly balanced search strategies.
> http://dx.doi.org/10.1016/0020-0190(90)90130-P
> 
> -- 
> Ihor Radchenko // yantar92,
> Org mode contributor,
> Learn more about Org mode at <https://orgmode.org/>.
> Support Org development at <https://liberapay.com/org-mode>,
> or support my work at <https://liberapay.com/yantar92>
> 



 command ‘org-element-cache-hash-show-statistics’ 
7.85% of cache searches hashed, 1.88% non-hashable.

emacs uptime: 22 hours, 24 minutes, 10 seconds

Org mode version 9.6.1 (release_9.6.1-23-gc45a05 @ /Applications/Emacs.app/Contents/Resources/lisp/org/)

GNU Emacs 30.0.50 (build 1, x86_64-apple-darwin22.2.0, NS appkit-2299.30 Version 13.1 (Build 22C65)) of 2023-02-08

Re: [RFC] If you use Org 9.6, please share the output of M-x org-element-cache-hash-show-statistics

[Kévin Le Gouguec]

Hey Ihor,

Ihor Radchenko <yantar92@posteo.net> writes:

> If you are ok with sharing the statistics, and you are running Emacs
> session for at least few hours (using Org mode, obviously), please reply
> sharing the output of
>  M-x org-element-cache-hash-show-statistics <RET>
>  M-x emacs-uptime <RET>

Here are the stats for today:

org-element-cache-hash-show-statistics:
> 19.32% of cache searches hashed, 11.88% non-hashable.

Evolution throughout the day: (don't know if *Messages* can be told to
add timestamps)

> 28.02% of cache searches hashed, 4.20% non-hashable.
> 19.79% of cache searches hashed, 13.80% non-hashable.
> 19.57% of cache searches hashed, 12.10% non-hashable.
> 19.25% of cache searches hashed, 11.93% non-hashable.
> 19.32% of cache searches hashed, 11.88% non-hashable.

emacs-uptime:
> 10 hours, 50 minutes, 12 seconds

emacs-version:
> GNU Emacs 30.0.50 (build 1, x86_64-pc-linux-gnu, GTK+ Version 3.24.20,
> cairo version 1.16.0) of 2023-02-06

emacs-repository-version:
> 907fd1f7ff402f9d226ebb3b891ea5b54fac1d1c

org-version:
> Org mode version 9.6.1 (release_9.6.1-23-gc45a05 @
> /usr/local/share/emacs/30.0.50/lisp/org/)

FWIW, this was with 5 Org files open, clocking in and out of 18 headings
out of a little under 2000 headings.

Hope that helps; let me know if there is more info I can collect
tomorrow.

Re: [RFC] If you use Org 9.6, please share the output of M-x org-element-cache-hash-show-statistics

[Kévin Le Gouguec]

Kévin Le Gouguec <kevin.legouguec@gmail.com> writes:

> Here are the stats for today:

And today's session:

> org-element-cache-hash-show-statistics:
>> 19.32% of cache searches hashed, 11.88% non-hashable.

23.65% of cache searches hashed, 17.88% non-hashable.

> emacs-uptime:
>> 10 hours, 50 minutes, 12 seconds

13 hours, 5 minutes, 31 seconds

> emacs-version:
>> GNU Emacs 30.0.50 (build 1, x86_64-pc-linux-gnu, GTK+ Version 3.24.20,
>> cairo version 1.16.0) of 2023-02-06
>
> emacs-repository-version:
>> 907fd1f7ff402f9d226ebb3b891ea5b54fac1d1c
>
> org-version:
>> Org mode version 9.6.1 (release_9.6.1-23-gc45a05 @
>> /usr/local/share/emacs/30.0.50/lisp/org/)
>
> FWIW, this was with 5 Org files open, clocking in and out of 18 headings
> out of a little under 2000 headings.

7 Org files open, clocking in and out of 19 headings.

Re: [RFC] If you use Org 9.6, please share the output of M-x org-element-cache-hash-show-statistics

[Jeffrey DeLeo]

Org mode version 9.6.1
15.80% of cache searches hashed, 5.90% non-hashable.
Emacs Uptime: 9 hours, 58 minutes, 8 seconds

Re: [RFC] If you use Org 9.6, please share the output of M-x org-element-cache-hash-show-statistics

[Simon Butler]

two computers, both running org mode version 9.6.1 and Emacs 27.1

1.00% of cache searches hashed, 0.00% non-hashable.
3 days, 11 hours, 17 minutes, 32 seconds


5.88% of cache searches hashed, 3.75% non-hashable.
3 days, 13 hours, 49 minutes, 16 seconds





On 2023-02-09 at 11:51 GMT, Ihor Radchenko <yantar92@posteo.net> wrote: 
> Hi,
>
> I would like to assess the efficiency of one of search optimizations used
> in org-element.el [1]
>
> The statistics about efficiency is collected by Org, but obviously not
> shared without your consent.
>
> If you are ok with sharing the statistics, and you are running Emacs
> session for at least few hours (using Org mode, obviously), please reply
> sharing the output of
>  M-x org-element-cache-hash-show-statistics <RET>
>  M-x emacs-uptime <RET>
>
> [1] Pugh [Information Processing Letters] (1990) Slow optimally balanced
>  search strategies vs. cached fast uniformly balanced search strategies.
>  http://dx.doi.org/10.1016/0020-0190(90)90130-P

Re: [RFC] If you use Org 9.6, please share the output of M-x org-element-cache-hash-show-statistics

[João Pedro]

On Thu, February 09 2023 11:51, Ihor Radchenko <yantar92@posteo.net> wrote:

> Hi,

Hello Ihor!

> If you are ok with sharing the statistics, and you are running Emacs
> session for at least few hours (using Org mode, obviously), please reply
> sharing the output of

Definitely OK with it! Here it goes

>  M-x org-element-cache-hash-show-statistics <RET>

22.63% of cache searches hashed, 1.71% non-hashable.

>  M-x emacs-uptime <RET>

2 days, 3 hours, 19 minutes, 31 seconds

Best regards,

-- 
João Pedro de A. Paula
IT bachelors at Universidade Federal do Rio Grande do Norte (UFRN)

Re: [RFC] If you use Org 9.6, please share the output of M-x org-element-cache-hash-show-statistics

[Jonathan Gregory]

Hi,

On 09 Feb 2023, Ihor Radchenko wrote:

> Hi,
>
> I would like to assess the efficiency of one of search 
> optimizations used in org-element.el [1]
>
> The statistics about efficiency is collected by Org, but 
> obviously not shared without your consent.
>
> If you are ok with sharing the statistics, and you are running 
> Emacs session for at least few hours (using Org mode, 
> obviously), please reply sharing the output of
> 
>  M-x org-element-cache-hash-show-statistics <RET>

18.64% of cache searches hashed, 7.90% non-hashable.

>  M-x emacs-uptime <RET>

8 days, 9 hours, 14 minutes, 34 seconds

> [1] Pugh [Information Processing Letters] (1990) Slow optimally 
> balanced search strategies vs. cached fast uniformly balanced 
> search strategies. 
> http://dx.doi.org/10.1016/0020-0190(90)90130-P


-- 
Jonathan

Re: [RFC] If you use Org 9.6, please share the output of M-x org-element-cache-hash-show-statistics

[Ted Reed via General discussions about Org-mode.]

Ihor Radchenko <yantar92@posteo.net> writes:
>
> If you are ok with sharing the statistics, and you are running Emacs
> session for at least few hours (using Org mode, obviously), please reply
> sharing the output of
>  M-x org-element-cache-hash-show-statistics <RET>
>  M-x emacs-uptime <RET>

I have emacs running on two machines right now, with the same set of
files and the same version of Org 9.6.1.

NixOS 22.11:

Org mode version 9.6.1 ( @ /nix/store/k8y11pil3q0fca3xc7ma1f1dsjqkxy47-emacs-packages-deps/share/emacs/site-lisp/elpa/org-9.6.1/)
29.84% of cache searches hashed, 0.33% non-hashable.
1 day, 13 hours, 28 minutes, 37 seconds

MacOS 12.3, with Nix:

Org mode version 9.6.1 ( @ /nix/store/6carlqy174ab1fwz6ihb4rz3sldvc555-emacs-packages-deps/share/emacs/site-lisp/elpa/org-9.6.1/)
31.70% of cache searches hashed, 0.75% non-hashable.
4 days, 19 hours, 45 minutes, 10 seconds

-- Ted Reed

Re: [RFC] If you use Org 9.6, please share the output of M-x org-element-cache-hash-show-statistics

[Detlev Zundel]

Ihor Radchenko <yantar92@posteo.net> writes:

>  M-x org-element-cache-hash-show-statistics <RET>
>  M-x emacs-uptime <RET>

#+begin_src elisp
org-element-cache-hash-show-statistics
#+end_src


-- 
Restrict Digital Restrictions Management:
If you can't copy it - don't buy it

Re: [RFC] If you use Org 9.6, please share the output of M-x org-element-cache-hash-show-statistics

[Detlev Zundel]

oops, C-c C-c in message mode sends the message, *smirk*

Ihor Radchenko <yantar92@posteo.net> writes:

  M-x org-element-cache-hash-show-statistics <RET>
  M-x emacs-uptime <RET>

#+begin_src elisp
(org-element-cache-hash-show-statistics)
#+end_src

#+RESULTS:
: 6.60% of cache searches hashed, 34.35% non-hashable.

#+begin_src elisp
(emacs-uptime)
#+end_src

#+RESULTS:
: 9 days, 22 hours, 28 minutes, 16 seconds

Re: [RFC] If you use Org 9.6, please share the output of M-x org-element-cache-hash-show-statistics

[Fraga, Eric]

10.48% of cache searches hashed, 5.66% non-hashable.
2 days, 17 hours, 12 minutes, 29 seconds

-- 
: Eric S Fraga, with org release_9.6-201-gb58fba in Emacs 30.0.50

Re: [RFC] If you use Org 9.6, please share the output of M-x org-element-cache-hash-show-statistics

[Alan Tyree]

[-- Attachment #1: Type: text/plain, Size: 479 bytes --]

3 days, 2 hours, 25 minutes, 36 seconds

2.35% of cache searches hashed, 78.11% non-hashable.

Org mode version 9.6.1 ( @ /home/alant/.emacs.d/elpa/org-9.6.1/)



On Fri, 10 Feb 2023 at 22:18, Fraga, Eric <e.fraga@ucl.ac.uk> wrote:

> 10.48% of cache searches hashed, 5.66% non-hashable.
> 2 days, 17 hours, 12 minutes, 29 seconds
>
> --
> : Eric S Fraga, with org release_9.6-201-gb58fba in Emacs 30.0.50
>


-- 
Alan L Tyree                    http://www2.austlii.edu.au/~alan

[-- Attachment #2: Type: text/html, Size: 1419 bytes --]

Re: [RFC] If you use Org 9.6, please share the output of M-x org-element-cache-hash-show-statistics

[Gregor Zattler]

Hi Ihor,
* Ihor Radchenko <yantar92@posteo.net> [2023-02-09; 11:51 GMT]:
> If you are ok with sharing the statistics, and you are running Emacs
> session for at least few hours (using Org mode, obviously), please reply
> sharing the output of
>  M-x org-element-cache-hash-show-statistics <RET>
4.77% of cache searches hashed, 2.52% non-hashable.

Wouldn't absolute number not be more interesting?

>  M-x emacs-uptime <RET>

6 hours, 59 minutes, 41 seconds



GNU Emacs 29.0.60 (build 3, x86_64-pc-linux-gnu, cairo version 1.16.0) of 2023-01-25

Org mode version 9.6.1 (release_9.6.1-208-g0c0059 @ /home/grfz/src/org-mode/lisp/)


Thanks for all your efforts, Gregor

Re: [RFC] If you use Org 9.6, please share the output of M-x org-element-cache-hash-show-statistics

[orzodk]

Ihor Radchenko <yantar92@posteo.net> writes:

> Hi,
>
> I would like to assess the efficiency of one of search optimizations used
> in org-element.el [1]
>
> The statistics about efficiency is collected by Org, but obviously not
> shared without your consent.
>
> If you are ok with sharing the statistics, and you are running Emacs
> session for at least few hours (using Org mode, obviously), please reply
> sharing the output of
>  M-x org-element-cache-hash-show-statistics <RET>
>  M-x emacs-uptime <RET>
>
> [1] Pugh [Information Processing Letters] (1990) Slow optimally balanced
>  search strategies vs. cached fast uniformly balanced search strategies.
>  http://dx.doi.org/10.1016/0020-0190(90)90130-P

20.43% of cache searches hashed, 29.71% non-hashable.

2 days, 5 hours, 49 minutes, 48 seconds

GNU Emacs 29.0.60 (build 1, aarch64-apple-darwin22.2.0, NS
appkit-2299.30 Version 13.1 (Build 22C65)) of 2023-02-08

Org mode version 9.6.1 (9.6.1-g02ae90 @
/Users/o/.emacs.d/straight/build/org/)

Re: [External] : [RFC] If you use Org 9.6, please share the output of M-x org-element-cache-hash-show-statistics

[Daniel Ortmann]

11.99% of cache searches hashed, 12.16% non-hashable.

13 hours, 20 minutes, 43 seconds

On 2/9/23 05:51, Ihor Radchenko wrote:
> Hi,
>
> I would like to assess the efficiency of one of search optimizations used
> in org-element.el [1]
>
> The statistics about efficiency is collected by Org, but obviously not
> shared without your consent.
>
> If you are ok with sharing the statistics, and you are running Emacs
> session for at least few hours (using Org mode, obviously), please reply
> sharing the output of
>   M-x org-element-cache-hash-show-statistics <RET>
>   M-x emacs-uptime <RET>
>
> [1] Pugh [Information Processing Letters] (1990) Slow optimally balanced
>   search strategies vs. cached fast uniformly balanced search strategies.
>   https://urldefense.com/v3/__http://dx.doi.org/10.1016/0020-0190(90)90130-P__;!!ACWV5N9M2RV99hQ!JwEvxu0CggVEXgYmfXdxPXq0nYdBMMbQ3NzQ6pTShxTfCLwft_6uaHlG2rbztwtljiKyvCyPZJDkkaaGDGJo$
>

Re: [RFC] If you use Org 9.6, please share the output of M-x org-element-cache-hash-show-statistics

[Ihor Radchenko]

Ihor Radchenko <yantar92@posteo.net> writes:

> I would like to assess the efficiency of one of search optimizations used
> in org-element.el [1]

Thanks everyone for responding!

It looks like the optimization is useful at least to some people (20%
cached searches is a good thing to have).

A number of people also reported significant fraction of cache queries
associated with editing (non-hashable). They cannot, unfortunately, be
handled by this particular optimization and I have to leave them as is.

I am thus leaving the code in place, removing the statistics gathering
parts.

https://git.savannah.gnu.org/cgit/emacs/org-mode.git/commit/?id=2bc510217

Done.

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>