unofficial mirror of notmuch@notmuchmail.org
 help / color / mirror / code / Atom feed
* dealing with a lot of emails in single dir
@ 2021-08-17 12:17 Aurélien Aptel
  2021-08-17 19:28 ` Tomi Ollila
  2021-08-17 23:25 ` David Bremner
  0 siblings, 2 replies; 3+ messages in thread
From: Aurélien Aptel @ 2021-08-17 12:17 UTC (permalink / raw)
  To: notmuch

Hi,

How do you deal with a maildir with a billion file in it? I'm on ext4
which should handle it but I can already feel some programs struggle
with a dir with that many entries (noticeable slow down).

I was thinking of archiving emails in yearly folders. How does notmuch
deal with moving emails around? Will I still be able to open them or
should I recreate the db?

If anyone is using lieer with gmail (https://github.com/gauteh/lieer)
will this trigger pulls of all the moved emails again?

Thanks

^ permalink raw reply	[flat|nested] 3+ messages in thread

* Re: dealing with a lot of emails in single dir
  2021-08-17 12:17 dealing with a lot of emails in single dir Aurélien Aptel
@ 2021-08-17 19:28 ` Tomi Ollila
  2021-08-17 23:25 ` David Bremner
  1 sibling, 0 replies; 3+ messages in thread
From: Tomi Ollila @ 2021-08-17 19:28 UTC (permalink / raw)
  To: Aurélien Aptel, notmuch

On Tue, Aug 17 2021, Aurélien Aptel wrote:

> Hi,
>
> How do you deal with a maildir with a billion file in it? I'm on ext4
> which should handle it but I can already feel some programs struggle
> with a dir with that many entries (noticeable slow down).

That reminded me:

http://be-n.com/spw/you-can-list-a-million-files-in-a-directory-but-not-with-ls.html

that talks about 8 million files in a dir and already that requires special
attention (i.e. readdir(3) slow, have to use getdents(2) syscall directly...

>
> I was thinking of archiving emails in yearly folders. How does notmuch
> deal with moving emails around? Will I still be able to open them or
> should I recreate the db?

cannot remember how how notmuch detect renames -- so before doing so you
should backup tags with notmuch-dump...

Tomi
 

>
> If anyone is using lieer with gmail (https://github.com/gauteh/lieer)
> will this trigger pulls of all the moved emails again?
>
> Thanks
> _______________________________________________
> notmuch mailing list -- notmuch@notmuchmail.org
> To unsubscribe send an email to notmuch-leave@notmuchmail.org

^ permalink raw reply	[flat|nested] 3+ messages in thread

* Re: dealing with a lot of emails in single dir
  2021-08-17 12:17 dealing with a lot of emails in single dir Aurélien Aptel
  2021-08-17 19:28 ` Tomi Ollila
@ 2021-08-17 23:25 ` David Bremner
  1 sibling, 0 replies; 3+ messages in thread
From: David Bremner @ 2021-08-17 23:25 UTC (permalink / raw)
  To: Aurélien Aptel, notmuch

Aurélien Aptel <aurelien.aptel@gmail.com> writes:

>
> I was thinking of archiving emails in yearly folders. How does notmuch
> deal with moving emails around? Will I still be able to open them or
> should I recreate the db?

"notmuch new" should detect the moves, but it may take some time. For a
sufficiently large number of moves it is faster to recreate the database.\r

^ permalink raw reply	[flat|nested] 3+ messages in thread

end of thread, other threads:[~2021-08-17 23:25 UTC | newest]

Thread overview: 3+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2021-08-17 12:17 dealing with a lot of emails in single dir Aurélien Aptel
2021-08-17 19:28 ` Tomi Ollila
2021-08-17 23:25 ` David Bremner

Code repositories for project(s) associated with this inbox:

	notmuch.git.git (no URL configured)

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).