From: pukkamustard <pukkamustard@posteo.net>
To: "Ludovic Courtès" <ludo@gnu.org>
Cc: guix-devel@gnu.org, guix-sysadmin@gnu.org
Subject: Re: Git-LFS or Git Annex?
Date: Wed, 24 Jan 2024 18:41:37 +0000 [thread overview]
Message-ID: <86jznyy13e.fsf@posteo.net> (raw)
In-Reply-To: <87mssuu57m.fsf@inria.fr>
Hi!
Ludovic Courtès <ludo@gnu.org> writes:
[..]
> From a quick look (I haven’t used them), Git-LFS seems to assume a
> rather centralized model where there’s an LFS server sitting next to the
> Git server¹. Git Annex looks more decentralized, allowing you to have
> several “remotes”, to check the status of each one, to sync them, etc.²
> Because of this, Git Annex seems to be a better fit.
I agree that Git Annex seems to be a better fit for the reasons you
list.
> What’s your experience? What would you suggest?
I've used Git Annex for managing many large files (~100s of GiBs) and it
worked. However, I found Git Annex to be quite complex and to do things
automatically without me fully realizing.
The use case was to use Git Annex to distribute large test vectors. This
involved many Git checkouts and worktrees on quite a few different hosts
- some of them ephermal. When running `git annex sync` Git Annex tries
to synchronize the current view of the state to all Git remotes (which
file is available where) with a lot of git pushing and pulling. It ended
up sharing remotes that are no longer existant or not-accessible and
somehow it was hard/impossible to remove reference to those remotes
(afaiu Git Annex remotes can only be marked as "dead" and not removed -
https://git-annex.branchable.com/git-annex-dead/). As the number of such
remotes increased, I became more and more confused.
But this is maybe a special use-case which is not relevant for video
sharing as you describe and probably reflects my inability to understand
how Git Annex works more than anything else.
Still, I would recommend to NOT store the videos in a remote Git
repository but a publicly accessible rsync server as a Git Annex special
remote (https://git-annex.branchable.com/special_remotes/).
Cheers,
pukkamustard
next prev parent reply other threads:[~2024-01-24 19:38 UTC|newest]
Thread overview: 19+ messages / expand[flat|nested] mbox.gz Atom feed top
2024-01-24 15:22 Git-LFS or Git Annex? Ludovic Courtès
2024-01-24 16:13 ` indieterminacy
2024-01-24 17:39 ` Giovanni Biscuolo
2024-01-28 10:33 ` Nicolas Graves via Development of GNU Guix and the GNU System distribution.
2024-01-28 11:32 ` Philip McGrath
2024-01-28 17:32 ` Giovanni Biscuolo
2024-01-29 11:39 ` Nicolas Graves via Development of GNU Guix and the GNU System distribution.
2024-01-24 18:41 ` pukkamustard [this message]
2024-01-24 20:32 ` Troy Figiel
2024-01-25 12:03 ` Giovanni Biscuolo
2024-01-25 16:55 ` Simon Tournier
2024-01-26 2:20 ` Kyle Meyer
2024-01-26 10:02 ` Simon Tournier
2024-01-27 16:59 ` Timothy Sample
2024-01-27 17:47 ` Kyle Meyer
2024-02-14 15:18 ` Simon Tournier
2024-01-27 4:31 ` Philip McGrath
2024-01-28 17:37 ` Efraim Flashner
2024-02-02 16:46 ` Christine Lemmer-Webber
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
List information: https://guix.gnu.org/
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=86jznyy13e.fsf@posteo.net \
--to=pukkamustard@posteo.net \
--cc=guix-devel@gnu.org \
--cc=guix-sysadmin@gnu.org \
--cc=ludo@gnu.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
Code repositories for project(s) associated with this public inbox
https://git.savannah.gnu.org/cgit/guix.git
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).