all messages for Guix-related lists mirrored at yhetil.org
 help / color / mirror / code / Atom feed
* RFC: libgit2 is slow/inefficient; switch to git command?
@ 2022-11-22  2:21 Maxim Cournoyer
  2022-11-22 15:39 ` zimoun
  2022-11-23 22:16 ` Ludovic Courtès
  0 siblings, 2 replies; 8+ messages in thread
From: Maxim Cournoyer @ 2022-11-22  2:21 UTC (permalink / raw)
  To: guix-devel

Hi,

While attempting to bisect against the Linux kernel tree, the
performance of libgit2 quickly became problematic, to the point where
simply cloning the repo became a multiple hours affair, using upward to
3 GiB of RAM for the clone and indexing of the objects (!)

Given that:

* the git CLI doesn't suffer from such poor performance;
* This kind of performance problem has been known for years in libgit2
  [0] with no fix in sight;
* other projects such as Cargo support using the git CLI and that
  projects are using it for that reason [1];

Would it make sense to switch to use the git command directly instead of
calling into this libgit2 C library that ends up being slower?  It would
provide a hefty speed-up when using 'guix refresh' or building new
packages fetched from git without substitutes, or using 'git-checkout',
etc.

What do you think?

[0] https://github.com/libgit2/libgit2/issues/4674
[1] https://github.com/artichoke/playground/pull/700

-- 
Thanks,
Maxim


^ permalink raw reply	[flat|nested] 8+ messages in thread

end of thread, other threads:[~2022-11-23 22:16 UTC | newest]

Thread overview: 8+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2022-11-22  2:21 RFC: libgit2 is slow/inefficient; switch to git command? Maxim Cournoyer
2022-11-22 15:39 ` zimoun
2022-11-22 16:49   ` Philip McGrath
2022-11-22 17:51     ` Wojtek Kosior via Development of GNU Guix and the GNU System distribution.
2022-11-22 21:15       ` Phil
2022-11-23  9:57         ` zimoun
2022-11-23 22:04         ` Ludovic Courtès
2022-11-23 22:16 ` Ludovic Courtès

Code repositories for project(s) associated with this external index

	https://git.savannah.gnu.org/cgit/guix.git

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.