Speeding up the agenda search

Speeding up the agenda search

[Marcelo de Moraes Serpa]

[-- Attachment #1: Type: text/plain, Size: 644 bytes --]

Hello everyone,

My list of files in the agenda got to a considerable size. It still
searchable, but some types of search, such as PROPERTY, usually lock down
emacs and I'm forced to kill the process. Is there any way to speed it up?
Perhaps by compiling the elisp files to bytecode?

I'm on OSX Lion, emacs: GNU Emacs 23.4.1 (x86_64-apple-darwin, NS
apple-appkit-1038.36) of 2012-01-29 on bob.porkrind.org
M
orgmode: Org-mode version 7.9.1 (release_7.9.1-299-g08c5ea.dirty-git @
mixed installation! /Applications/Emacs.app/Contents/Resources/lisp/org/
and /Users/fullofcaffeine/.emacs.d/vendor/org/lisp/)
M

Any hints appreciated,

- Marcelo.

[-- Attachment #2: Type: text/html, Size: 811 bytes --]

Re: Speeding up the agenda search

[Marcelo de Moraes Serpa]

[-- Attachment #1: Type: text/plain, Size: 896 bytes --]

Anyone else with huge org "databases" out there? Any tips on improving
performance of the agenda search would be appreciated :)

On Sat, Oct 20, 2012 at 12:29 AM, Marcelo de Moraes Serpa <
celoserpa@gmail.com> wrote:

> Hello everyone,
>
> My list of files in the agenda got to a considerable size. It still
> searchable, but some types of search, such as PROPERTY, usually lock down
> emacs and I'm forced to kill the process. Is there any way to speed it up?
> Perhaps by compiling the elisp files to bytecode?
>
> I'm on OSX Lion, emacs: GNU Emacs 23.4.1 (x86_64-apple-darwin, NS
> apple-appkit-1038.36) of 2012-01-29 on bob.porkrind.org
> M
> orgmode: Org-mode version 7.9.1 (release_7.9.1-299-g08c5ea.dirty-git @
> mixed installation! /Applications/Emacs.app/Contents/Resources/lisp/org/
> and /Users/fullofcaffeine/.emacs.d/vendor/org/lisp/)
> M
>
> Any hints appreciated,
>
> - Marcelo.
>

[-- Attachment #2: Type: text/html, Size: 1324 bytes --]

Re: Speeding up the agenda search

[François Allisson]

Marcelo de Moraes Serpa writes:

> Anyone else with huge org "databases" out there? Any tips on improving
> performance of the agenda search would be appreciated :)
>

Hi Marcello,

16 files and 3 MB: is that huge for you?

Note that only 13 (1.5 MB) are agenda files; the "big three others" (2
databases and 1 archive file; 1.5 MB) are added to the search via
org-agenda-search-extra-files.

As I never had to "kill" a search, that is probably not huge...

Best,

François.

Re: Speeding up the agenda search

[Bastien]

Hi Marcelo,

Marcelo de Moraes Serpa <celoserpa@gmail.com> writes:

> My list of files in the agenda got to a considerable size. It still
> searchable, but some types of search, such as PROPERTY, usually lock
> down emacs and I'm forced to kill the process. Is there any way to
> speed it up? Perhaps by compiling the elisp files to bytecode? 

Speed of the agenda generation is a often a problem.

It's a delicate one because subjective and objective problems
are often closely entangled in this area (speed of your machine,
perceived acceptable speed for generating the agenda, complexity
of the query, size of your agenda files, etc.)

The only way we can make progress here is by rolling our sleeves
and performing tiny optimizations, one after another.

As a first step, you can try to make a diagnosis the problem by
instrumenting the agenda functions:

  M-x elp-instrument-package RET org-agenda RET

Then doing your agenda query then reporting results 

  M-x elp-results RET

We'll get a rough idea of the time spent and be able to compare
it with the one on other machines.  

Thanks,

-- 
 Bastien