How to Extract public-inbox v2 to Maildir

How to Extract public-inbox v2 to Maildir

[Danh Doan]

Hello public-inbox's developers,

I'm a happer user of ssoma.
I used to sync public-inbox's archive of git to a separate copy in
Maildir format in my local repository.

I see a move to lore.kernel.org/git for git archive, I tried to update
my ssoma configuration to point to lore.kernel.org.

To my surprise, it doesn't work because lore.kernel.org use version
2 of public-inbox's repository.

I tried to read both ssoma, and public-inbox documentation to figure
out it, but I have no luck.

Would it is easy (and desired) to have this in public-inbox, since
I saw a notice that ssoma won't support v2.

I think Email::LocalMailDelivery is the ways to go, but I haven't done
any Perl yet.

I would like to have a pointer, so I can implement this myself if
public-inbox don't want this feature.

-- 
Danh

Re: How to Extract public-inbox v2 to Maildir

[Eric Wong]

Danh Doan <congdanhqx@gmail.com> wrote:
> To my surprise, it doesn't work because lore.kernel.org use version
> 2 of public-inbox's repository.

Right...

> Would it is easy (and desired) to have this in public-inbox, since
> I saw a notice that ssoma won't support v2.

If you like Maildir, there's l2md:
https://git.kernel.org/pub/scm/linux/kernel/git/dborkman/l2md.git/

I guess it'd be helpful to have a clients list in our
documentation somewhere...

Maybe I'll have time to work on some client tools, probably in
the vein of mairix where it'll dump search results into a
Maildir/mbox/IMAP folder.

Fwiw, I don't like Maildir for long-term storage at all, it's
fine for volatile inboxes, but has the same problems as loose
git objects which I don't like.

> I think Email::LocalMailDelivery is the ways to go, but I haven't done
> any Perl yet.

I'm moving away from the Email::* namespace since it's mostly
poorly-maintained, bloated, and unavailable from some distros.

More stuff is going in-tree, and Inline::C + liburing will be an
option for doing FS I/O :)

> I would like to have a pointer, so I can implement this myself if
> public-inbox don't want this feature.

I suggest l2md for now :)

Re: How to Extract public-inbox v2 to Maildir

[Eric Wong]

Eric Wong <e@yhbt.net> wrote:
> If you like Maildir, there's l2md:
> https://git.kernel.org/pub/scm/linux/kernel/git/dborkman/l2md.git/

Oh, there's also impibe:

	https://public-inbox.org/meta/87zhbcldi4.fsf@vuxu.org/

> I guess it'd be helpful to have a clients list in our
> documentation somewhere...

Yes, I'm scatter-brained :x

Re: How to Extract public-inbox v2 to Maildir

[Danh Doan]

On 2020-04-26 06:05:42+0000, Eric Wong <e@yhbt.net> wrote:
> Danh Doan <congdanhqx@gmail.com> wrote:
> > To my surprise, it doesn't work because lore.kernel.org use version
> > 2 of public-inbox's repository.
> 
> Right...
> 
> > Would it is easy (and desired) to have this in public-inbox, since
> > I saw a notice that ssoma won't support v2.
> 
> If you like Maildir, there's l2md:
> https://git.kernel.org/pub/scm/linux/kernel/git/dborkman/l2md.git/
> 
> I guess it'd be helpful to have a clients list in our
> documentation somewhere...
> 
> Maybe I'll have time to work on some client tools, probably in
> the vein of mairix where it'll dump search results into a
> Maildir/mbox/IMAP folder.
> 
> Fwiw, I don't like Maildir for long-term storage at all, it's
> fine for volatile inboxes, but has the same problems as loose
> git objects which I don't like.

Yes, it's scattered over filesystem, which harms performance.
But, at least, I can use notmuch with it.

Right now, I need to run public-inbox-nttpd to be able to read the
archive, and public-inbox-httpd to search.

> > I would like to have a pointer, so I can implement this myself if
> > public-inbox don't want this feature.
> 
> I suggest l2md for now :)

Thanks, I'll look into it.

-- 
Danh