* dealing with a lot of emails in single dir
@ 2021-08-17 12:17 Aurélien Aptel
2021-08-17 19:28 ` Tomi Ollila
2021-08-17 23:25 ` David Bremner
0 siblings, 2 replies; 3+ messages in thread
From: Aurélien Aptel @ 2021-08-17 12:17 UTC (permalink / raw)
To: notmuch
Hi,
How do you deal with a maildir with a billion file in it? I'm on ext4
which should handle it but I can already feel some programs struggle
with a dir with that many entries (noticeable slow down).
I was thinking of archiving emails in yearly folders. How does notmuch
deal with moving emails around? Will I still be able to open them or
should I recreate the db?
If anyone is using lieer with gmail (https://github.com/gauteh/lieer)
will this trigger pulls of all the moved emails again?
Thanks
^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: dealing with a lot of emails in single dir
2021-08-17 12:17 dealing with a lot of emails in single dir Aurélien Aptel
@ 2021-08-17 19:28 ` Tomi Ollila
2021-08-17 23:25 ` David Bremner
1 sibling, 0 replies; 3+ messages in thread
From: Tomi Ollila @ 2021-08-17 19:28 UTC (permalink / raw)
To: Aurélien Aptel, notmuch
On Tue, Aug 17 2021, Aurélien Aptel wrote:
> Hi,
>
> How do you deal with a maildir with a billion file in it? I'm on ext4
> which should handle it but I can already feel some programs struggle
> with a dir with that many entries (noticeable slow down).
That reminded me:
http://be-n.com/spw/you-can-list-a-million-files-in-a-directory-but-not-with-ls.html
that talks about 8 million files in a dir and already that requires special
attention (i.e. readdir(3) slow, have to use getdents(2) syscall directly...
>
> I was thinking of archiving emails in yearly folders. How does notmuch
> deal with moving emails around? Will I still be able to open them or
> should I recreate the db?
cannot remember how how notmuch detect renames -- so before doing so you
should backup tags with notmuch-dump...
Tomi
>
> If anyone is using lieer with gmail (https://github.com/gauteh/lieer)
> will this trigger pulls of all the moved emails again?
>
> Thanks
> _______________________________________________
> notmuch mailing list -- notmuch@notmuchmail.org
> To unsubscribe send an email to notmuch-leave@notmuchmail.org
^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: dealing with a lot of emails in single dir
2021-08-17 12:17 dealing with a lot of emails in single dir Aurélien Aptel
2021-08-17 19:28 ` Tomi Ollila
@ 2021-08-17 23:25 ` David Bremner
1 sibling, 0 replies; 3+ messages in thread
From: David Bremner @ 2021-08-17 23:25 UTC (permalink / raw)
To: Aurélien Aptel, notmuch
Aurélien Aptel <aurelien.aptel@gmail.com> writes:
>
> I was thinking of archiving emails in yearly folders. How does notmuch
> deal with moving emails around? Will I still be able to open them or
> should I recreate the db?
"notmuch new" should detect the moves, but it may take some time. For a
sufficiently large number of moves it is faster to recreate the database.\r
^ permalink raw reply [flat|nested] 3+ messages in thread
end of thread, other threads:[~2021-08-17 23:25 UTC | newest]
Thread overview: 3+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2021-08-17 12:17 dealing with a lot of emails in single dir Aurélien Aptel
2021-08-17 19:28 ` Tomi Ollila
2021-08-17 23:25 ` David Bremner
Code repositories for project(s) associated with this public inbox
https://yhetil.org/notmuch.git/
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).