From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0.migadu.com ([2001:41d0:303:e16b::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms8.migadu.com with LMTPS id eD2/EmZOsmXBIQAAqHPOHw:P1 (envelope-from ) for ; Thu, 25 Jan 2024 13:04:54 +0100 Received: from aspmx1.migadu.com ([2001:41d0:303:e16b::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0.migadu.com with LMTPS id eD2/EmZOsmXBIQAAqHPOHw (envelope-from ) for ; Thu, 25 Jan 2024 13:04:54 +0100 X-Envelope-To: larch@yhetil.org Authentication-Results: aspmx1.migadu.com; dkim=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org"; dmarc=none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1706184294; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:in-reply-to:in-reply-to: references:references:list-id:list-help:list-unsubscribe: list-subscribe:list-post; bh=8+wVgWmmo+knVc9yn3y35dAzdfxHrzZJAT+Bnb0GuYU=; b=f2lVZfb6Qlma7S47KFe5QxnXu2TQu3Ogq8u/5jPLxpOD4b1uZCKnpjsffAYTsEq9FVaPcW 1pivu1QCWOKipVsAZuwNFdgwepJSaQ++ncL2VT97QUivWrV17BRAbMDnXGJ1DZs34OblZX Rs04pt+ar64St+KBh8GKIhbH0vYH7cJMrO1kcVIBMERN+LdnhbXE9E56x5esgdTAsuw/OQ X9LP3+SM5xag6zkTSnziqZkABi34MhjAZCpIbXkBxP98rvmb/GBWUsRAoZQxqjGGFdaywL Dlcr46cx7EsM9vM9LATfIaKRlu7zeFcAWcAAzqHUivr3Bg82RjqIvl2r/RdgwA== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org"; dmarc=none ARC-Seal: i=1; s=key1; d=yhetil.org; t=1706184294; a=rsa-sha256; cv=none; b=tMLTHW3/4OFbTyT3AmK6hLl/gYypnjGYmE/Zx6/ZrFUyTlu4mowZ6N494lOwujOz1MZ/tI UfFE4/VKgXts1FNw6H7saimMDd1IZftzp80q25NfUX987MaFbwgfUaCbuTNoNtAGScYsQn znFpDjz1leAhTDJJzGkDjOSCZTHv9uJRAxokst3u3mk7Y6EWDjkd80XAGSX8L+nvlvT39l jc3YJS1wnl4KKmgWpxCLN3gQe47VqNXR2NTEdoJfFTOf9pKCD2rnnu0nC76KvHX2DHscys rI5Q0V6IYEF6z/i+vu5Dwjrz9GClQ0xRJ0kZMqT+rruKOMzEwBYRakveShSioA== Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id A181456D3D for ; Thu, 25 Jan 2024 13:04:53 +0100 (CET) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1rSySi-00072d-Bs; Thu, 25 Jan 2024 07:04:04 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1rSySd-000721-42; Thu, 25 Jan 2024 07:03:59 -0500 Received: from ns13.heimat.it ([46.4.214.66]) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1rSySb-0007gc-5A; Thu, 25 Jan 2024 07:03:58 -0500 Received: from localhost (ip6-localhost [127.0.0.1]) by ns13.heimat.it (Postfix) with ESMTP id E888C30022F; Thu, 25 Jan 2024 12:03:53 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at ns13.heimat.it Received: from ns13.heimat.it ([127.0.0.1]) by localhost (ns13.heimat.it [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id pk_h50j0XrGc; Thu, 25 Jan 2024 12:03:50 +0000 (UTC) Received: from bourrache.mug.xelera.it (unknown [93.56.171.217]) (using TLSv1.2 with cipher ECDHE-ECDSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by ns13.heimat.it (Postfix) with ESMTPSA id D4D463001D5; Thu, 25 Jan 2024 12:03:50 +0000 (UTC) Received: from roquette.mug.biscuolo.net (roquette [10.38.2.14]) by bourrache.mug.xelera.it (Postfix) with SMTP id 376252DD86AA; Thu, 25 Jan 2024 13:03:50 +0100 (CET) Received: (nullmailer pid 7144 invoked by uid 1000); Thu, 25 Jan 2024 12:03:49 -0000 From: Giovanni Biscuolo To: pukkamustard , Ludovic =?utf-8?Q?Court=C3=A8s?= Cc: guix-devel@gnu.org, guix-sysadmin@gnu.org Subject: Re: Git-LFS or Git Annex? In-Reply-To: <86jznyy13e.fsf@posteo.net> Organization: Xelera.eu References: <87mssuu57m.fsf@inria.fr> <86jznyy13e.fsf@posteo.net> Date: Thu, 25 Jan 2024 13:03:49 +0100 Message-ID: <875xzh8vru.fsf@xelera.eu> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" Received-SPF: pass client-ip=46.4.214.66; envelope-from=g@xelera.eu; helo=ns13.heimat.it X-Spam_score_int: -18 X-Spam_score: -1.9 X-Spam_bar: - X-Spam_report: (-1.9 / 5.0 requ) BAYES_00=-1.9, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: guix-devel-bounces+larch=yhetil.org@gnu.org X-Migadu-Flow: FLOW_IN X-Migadu-Country: US X-Migadu-Spam-Score: -7.26 X-Migadu-Scanner: mx13.migadu.com X-Spam-Score: -7.26 X-Migadu-Queue-Id: A181456D3D X-TUID: y+bSO1ldwQq+ --=-=-= Content-Type: text/plain Content-Transfer-Encoding: quoted-printable Hi pukkamustard, git-annex is complex but no so complicated when you learn the two foundamental concepts (sorry if I say something obvious to you!): 1. only the names of the files and some other metadata are stored in a git repository when using git-annex, the content is not; when you "git annex add some-media" it is (locally!) stored in a special folder named .git/annex/ 2. content can be transfered (get, put) from one repository to another and the tool used to transfer depends (automatically choosen by git-annex) on the remote where the data is (rsync, cp or curl), there are also many "special remotes" available for data transfer. (see https://git-annex.branchable.com/walkthrough/#index11h2 for an ssh git-annex remote) See https://git-annex.branchable.com/how_it_works/ for a general description and https://git-annex.branchable.com/internals/ for a description of the content of each git-annex managed (and reserved) directory. Just to make it clear, you can have one or more "plain" git remotes just for location tracking and one or more git-annex remotes (also special remotes) for file transfes (and location tracking if they are also regular git remotes) pukkamustard writes: [...] > It ended up sharing remotes that are no longer existant or > not-accessible and somehow it was hard/impossible to remove reference > to those remotes (afaiu Git Annex remotes can only be marked as "dead" > and not removed - > https://git-annex.branchable.com/git-annex-dead/). As the number of > such remotes increased, I became more and more confused. https://git-annex.branchable.com/git-annex-dead/: =2D-8<---------------cut here---------------start------------->8--- This command exists to deal with situations where data has been lost, and you know it has, and you want to stop being reminded of that fact. When a repository is specified, indicates that the repository has been irretrievably lost, so it will not be listed in eg, git annex whereis. =2D-8<---------------cut here---------------end--------------->8--- If you want git-annex to definitely forget about dead repositories (throwing away historical data about past locations of files) you can use "git-annex forget --drop-dead" If you want to remove a remote (and stop syncing with it) you can do it as you do with any git remote: "git remote rm " [...] > Still, I would recommend to NOT store the videos in a remote Git > repository but a publicly accessible rsync server as a Git Annex > special remote (https://git-annex.branchable.com/special_remotes/). Good catch! This way we can still use the current Savannah git hosted remote (not supporting git-annex-shell, AFAIK) for location tracking and the same (or more) rsync servers we are using to store media. Thanks! Gio' =2D-=20 Giovanni Biscuolo Xelera IT Infrastructures --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQJABAEBCgAqFiEERcxjuFJYydVfNLI5030Op87MORIFAmWyTiUMHGdAeGVsZXJh LmV1AAoJENN9DqfOzDkS4osP/3tyu3XDkNASyleHYsG7V1nmxZ5ayVEYQpyh8ISW EpPGLr1EaSItBwj11iatx9pMmjTfYyarJl4pqmajdVuawnuXimSzxxnfzZrbmfJU SaC3bdDMIcHGqtRfht85pL79ltFSgcj55mjk5/9VauvKCRU/TZ8e/BoEWSAPmmBM 6DcmPNYgU+KP8PoeWbdGUdD6foC73EQ3ZJ8kghEGPgMBfYSyPxzRYzmYk9aFvLu4 3lAda2V0RiXMUgGmUAqA0LWgLZ36XgT5AGuGFrVyoA6Xbt2o8YcwgOrgE6OPhIm/ SC+dSaYaQOoGkGvaQARdeYZar3quaLobTzjF297pgnZT6C6Ke3CqM9GYOLK/9Xy/ hReIk96lrEx2wCGEpIO+KpMmWMf37KpE9jtPdVsuchX7/DfG9XrNcgg8Fqp+AcSz ksZHRXJNRkGPVPXNFjkxN0U+UekKTfI+9ZgE66pKc3smMDqN1d3z5VQAO6Wur/Co HK26NnGXmx9L+KzED+F+h0NgcjNJ5sQ/9+zyGLnJo9E5iEQmBmUOeQ4x0EME1Xna HNB6vFwXMveDB7HtTC0eqVW0xwQSfteHk9cyAleChJ504okRQUXeiugWZCR4cffH xQAOcB/UTISqJyyQFQ1Z+CX0zlr7VQCDyPaLLatg/lp3yuucwzAXLkcgwU+2kxYY 5jYn =0u0N -----END PGP SIGNATURE----- --=-=-=--