From mboxrd@z Thu Jan 1 00:00:00 1970 From: Marcelo de Moraes Serpa Subject: Speeding up the agenda search Date: Sat, 20 Oct 2012 00:29:58 -0500 Message-ID: Mime-Version: 1.0 Content-Type: multipart/alternative; boundary=14dae934044d49cde104cc76e991 Return-path: Received: from eggs.gnu.org ([208.118.235.92]:39155) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1TPRdJ-0005n7-3N for emacs-orgmode@gnu.org; Sat, 20 Oct 2012 01:30:03 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1TPRdH-0006OS-Ps for emacs-orgmode@gnu.org; Sat, 20 Oct 2012 01:30:01 -0400 Received: from mail-ie0-f169.google.com ([209.85.223.169]:55590) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1TPRdH-0006OO-Iz for emacs-orgmode@gnu.org; Sat, 20 Oct 2012 01:29:59 -0400 Received: by mail-ie0-f169.google.com with SMTP id 10so2083426ied.0 for ; Fri, 19 Oct 2012 22:29:59 -0700 (PDT) List-Id: "General discussions about Org-mode." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org@gnu.org Sender: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org@gnu.org To: Org Mode --14dae934044d49cde104cc76e991 Content-Type: text/plain; charset=ISO-8859-1 Hello everyone, My list of files in the agenda got to a considerable size. It still searchable, but some types of search, such as PROPERTY, usually lock down emacs and I'm forced to kill the process. Is there any way to speed it up? Perhaps by compiling the elisp files to bytecode? I'm on OSX Lion, emacs: GNU Emacs 23.4.1 (x86_64-apple-darwin, NS apple-appkit-1038.36) of 2012-01-29 on bob.porkrind.org M orgmode: Org-mode version 7.9.1 (release_7.9.1-299-g08c5ea.dirty-git @ mixed installation! /Applications/Emacs.app/Contents/Resources/lisp/org/ and /Users/fullofcaffeine/.emacs.d/vendor/org/lisp/) M Any hints appreciated, - Marcelo. --14dae934044d49cde104cc76e991 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hello everyone,

My list of files in the agenda got to a = considerable size. It still searchable, but some types of search, such as P= ROPERTY, usually lock down emacs and I'm forced to kill the process. Is= there any way to speed it up? Perhaps by compiling the elisp files to byte= code?=A0

I'm on OSX Lion, emacs:=A0GNU Emacs 23.4.1 (x86_64-= apple-darwin, NS apple-appkit-1038.36) of 2012-01-29 on bob.porkrind.org
M
orgmode:=A0Org-mode v= ersion 7.9.1 (release_7.9.1-299-g08c5ea.dirty-git @ mixed installation! /Ap= plications/Emacs.app/Contents/Resources/lisp/org/ and /Users/fullofcaffeine= /.emacs.d/vendor/org/lisp/)
M

Any hints appreciated,

= - Marcelo.
--14dae934044d49cde104cc76e991-- From mboxrd@z Thu Jan 1 00:00:00 1970 From: Marcelo de Moraes Serpa Subject: Re: Speeding up the agenda search Date: Mon, 22 Oct 2012 11:36:05 -0500 Message-ID: References: Mime-Version: 1.0 Content-Type: multipart/alternative; boundary=f46d0447f21a2d62d404cca87331 Return-path: Received: from eggs.gnu.org ([208.118.235.92]:53032) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1TQKz4-0004y2-KE for emacs-orgmode@gnu.org; Mon, 22 Oct 2012 12:36:14 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1TQKz1-0007CU-0H for emacs-orgmode@gnu.org; Mon, 22 Oct 2012 12:36:10 -0400 Received: from mail-ia0-f169.google.com ([209.85.210.169]:32883) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1TQKz0-0007CO-RM for emacs-orgmode@gnu.org; Mon, 22 Oct 2012 12:36:06 -0400 Received: by mail-ia0-f169.google.com with SMTP id h37so2893979iak.0 for ; Mon, 22 Oct 2012 09:36:05 -0700 (PDT) In-Reply-To: List-Id: "General discussions about Org-mode." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org@gnu.org Sender: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org@gnu.org To: Org Mode --f46d0447f21a2d62d404cca87331 Content-Type: text/plain; charset=ISO-8859-1 Anyone else with huge org "databases" out there? Any tips on improving performance of the agenda search would be appreciated :) On Sat, Oct 20, 2012 at 12:29 AM, Marcelo de Moraes Serpa < celoserpa@gmail.com> wrote: > Hello everyone, > > My list of files in the agenda got to a considerable size. It still > searchable, but some types of search, such as PROPERTY, usually lock down > emacs and I'm forced to kill the process. Is there any way to speed it up? > Perhaps by compiling the elisp files to bytecode? > > I'm on OSX Lion, emacs: GNU Emacs 23.4.1 (x86_64-apple-darwin, NS > apple-appkit-1038.36) of 2012-01-29 on bob.porkrind.org > M > orgmode: Org-mode version 7.9.1 (release_7.9.1-299-g08c5ea.dirty-git @ > mixed installation! /Applications/Emacs.app/Contents/Resources/lisp/org/ > and /Users/fullofcaffeine/.emacs.d/vendor/org/lisp/) > M > > Any hints appreciated, > > - Marcelo. > --f46d0447f21a2d62d404cca87331 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Anyone else with huge org "databases" out there? Any tips on impr= oving performance of the agenda search would be appreciated :)
On Sat, Oct 20, 2012 at 12:29 AM, Marcelo de Mo= raes Serpa <celoserpa@gmail.com> wrote:
Hello everyone,

My list o= f files in the agenda got to a considerable size. It still searchable, but = some types of search, such as PROPERTY, usually lock down emacs and I'm= forced to kill the process. Is there any way to speed it up? Perhaps by co= mpiling the elisp files to bytecode?=A0

I'm on OSX Lion, emacs:=A0GNU Emacs 23.4.1 (x86_64-= apple-darwin, NS apple-appkit-1038.36) of 2012-01-29 on bob.porkrind.org
M
org= mode:=A0Org-mode version 7.9.1 (release_7.9.1-299-g08c5ea.dirty-git @ mixed= installation! /Applications/Emacs.app/Contents/Resources/lisp/org/ and /Us= ers/fullofcaffeine/.emacs.d/vendor/org/lisp/)
M

Any hints appreciated,

= - Marcelo.

--f46d0447f21a2d62d404cca87331-- From mboxrd@z Thu Jan 1 00:00:00 1970 From: =?utf-8?Q?Fran=C3=A7ois?= Allisson Subject: Re: Speeding up the agenda search Date: Mon, 22 Oct 2012 19:33:02 +0200 Message-ID: <87wqyiif8x.fsf@allisson.co> References: , Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Return-path: Received: from eggs.gnu.org ([208.118.235.92]:51354) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1TQLrX-0002ke-8U for emacs-orgmode@gnu.org; Mon, 22 Oct 2012 13:32:28 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1TQLrW-0007FU-Cz for emacs-orgmode@gnu.org; Mon, 22 Oct 2012 13:32:27 -0400 Received: from relay3-d.mail.gandi.net ([217.70.183.195]:39445) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1TQLrW-0007FP-67 for emacs-orgmode@gnu.org; Mon, 22 Oct 2012 13:32:26 -0400 In-reply-to: List-Id: "General discussions about Org-mode." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org@gnu.org Sender: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org@gnu.org To: Marcelo de Moraes Serpa Cc: Org Mode Marcelo de Moraes Serpa writes: > Anyone else with huge org "databases" out there? Any tips on improving > performance of the agenda search would be appreciated :) > Hi Marcello, 16 files and 3 MB: is that huge for you? Note that only 13 (1.5 MB) are agenda files; the "big three others" (2 databases and 1 archive file; 1.5 MB) are added to the search via org-agenda-search-extra-files. As I never had to "kill" a search, that is probably not huge... Best, Fran=C3=A7ois. From mboxrd@z Thu Jan 1 00:00:00 1970 From: Bastien Subject: Re: Speeding up the agenda search Date: Wed, 24 Oct 2012 16:12:49 +0200 Message-ID: <87bofs2c2m.fsf@bzg.ath.cx> References: Mime-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit Return-path: Received: from eggs.gnu.org ([208.118.235.92]:43730) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1TR1hK-00007j-Gz for emacs-orgmode@gnu.org; Wed, 24 Oct 2012 10:12:52 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1TR1hB-0007tT-09 for emacs-orgmode@gnu.org; Wed, 24 Oct 2012 10:12:42 -0400 Received: from mail-wi0-f177.google.com ([209.85.212.177]:55466) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1TR1hA-0007tJ-QA for emacs-orgmode@gnu.org; Wed, 24 Oct 2012 10:12:32 -0400 Received: by mail-wi0-f177.google.com with SMTP id hj13so405642wib.12 for ; Wed, 24 Oct 2012 07:12:32 -0700 (PDT) In-Reply-To: (Marcelo de Moraes Serpa's message of "Sat, 20 Oct 2012 00:29:58 -0500") List-Id: "General discussions about Org-mode." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org@gnu.org Sender: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org@gnu.org To: Marcelo de Moraes Serpa Cc: Org Mode Hi Marcelo, Marcelo de Moraes Serpa writes: > My list of files in the agenda got to a considerable size. It still > searchable, but some types of search, such as PROPERTY, usually lock > down emacs and I'm forced to kill the process. Is there any way to > speed it up? Perhaps by compiling the elisp files to bytecode?  Speed of the agenda generation is a often a problem. It's a delicate one because subjective and objective problems are often closely entangled in this area (speed of your machine, perceived acceptable speed for generating the agenda, complexity of the query, size of your agenda files, etc.) The only way we can make progress here is by rolling our sleeves and performing tiny optimizations, one after another. As a first step, you can try to make a diagnosis the problem by instrumenting the agenda functions: M-x elp-instrument-package RET org-agenda RET Then doing your agenda query then reporting results M-x elp-results RET We'll get a rough idea of the time spent and be able to compare it with the one on other machines. Thanks, -- Bastien