From: Hartmut Goebel <h.goebel@crazy-compilers.com>
To: guix-devel <guix-devel@gnu.org>
Subject: (Re-) Designing extractong-downaloder
Date: Wed, 23 Feb 2022 09:57:59 +0100 [thread overview]
Message-ID: <a0ea5c8b-53a4-f5a1-94db-cc68e76eb730@crazy-compilers.com> (raw)
Hi,
TL;DR: What do you think about the idea of an „extracting dowloader“?
I'm about pick up work on „extracting downloader“ and the rebar build
system (for erlang), see <https://issues.guix.gnu.org/51061> for a first
try, In the aforementioned issue some points came up regarding the basic
design of the patch. Thus before starting to write code, I'd like to
agree on a basic design.
The basic idea behind „extracting downloader“ is as follows: Packages
provided by hex.pm (the distribution repository for erlang and elixir
packages) are tar-archives containing some meta-data files and the
actual source (contents.tar.gz), see example below, So the ideas was to
only store the contents.tar.gz (instead of requiring an additional
unpacking step).
In some earlier discussion someone mentioned, this could be interesting
for ruby gems, too.
Storing only the archive would allow to have the archive's hash as the
"source"-hash and allow for easy validation of the hash. Anyhow, much of
the complexity of the current implementation (see issue 51061) is caused
by this idea, since the code needs to postbone hashing to after the
download.
Also In some earlier discussion Ludo (afair) brought up the point
whether e.g. swh would be able provide a source-package if hased this way.
What do you think about the idea of an „extracting dowloader“?
Example for a package from hex.pm:
$ wget https://repo.hex.pm/tarballs/getopt-1.0.2.tar
…
$ tar tvf getopt-1.0.2.tar
-rw-r--r-- 0/0 1 2000-01-01 01:00 VERSION
-rw-r--r-- 0/0 64 2000-01-01 01:00 CHECKSUM
-rw-r--r-- 0/0 451 2000-01-01 01:00 metadata.config
-rw-r--r-- 0/0 14513 2000-01-01 01:00 contents.tar.gz
--
Regards
Hartmut Goebel
| Hartmut Goebel | h.goebel@crazy-compilers.com |
| www.crazy-compilers.com | compilers which you thought are impossible |
next reply other threads:[~2022-02-23 8:59 UTC|newest]
Thread overview: 8+ messages / expand[flat|nested] mbox.gz Atom feed top
2022-02-23 8:57 Hartmut Goebel [this message]
2022-02-23 10:52 ` (Re-) Designing extractong-downaloder pukkamustard
2022-02-24 8:50 ` Hartmut Goebel
2022-02-23 12:30 ` Maxime Devos
2022-02-23 12:35 ` Maxime Devos
2022-02-24 8:56 ` Hartmut Goebel
[not found] ` <beb0e29f-6066-d1b5-b560-22a3d0a98ad8@goebel-consult.de>
[not found] ` <87h77ly1ja.fsf@gmail.com>
2022-04-06 16:44 ` Designing importers (was: (Re-) Designing extracting-downloader) Hartmut Goebel
2022-04-10 20:33 ` Designing importers Ludovic Courtès
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
List information: https://guix.gnu.org/
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=a0ea5c8b-53a4-f5a1-94db-cc68e76eb730@crazy-compilers.com \
--to=h.goebel@crazy-compilers.com \
--cc=guix-devel@gnu.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
Code repositories for project(s) associated with this public inbox
https://git.savannah.gnu.org/cgit/guix.git
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).