From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id wEiBNBkS2V97HgAA0tVLHw (envelope-from ) for ; Tue, 15 Dec 2020 19:44:25 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0 with LMTPS id CHxQMBkS2V/LcwAA1q6Kng (envelope-from ) for ; Tue, 15 Dec 2020 19:44:25 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 9CF64940480 for ; Tue, 15 Dec 2020 19:44:25 +0000 (UTC) Received: from localhost ([::1]:44190 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kpGFE-0006lp-Fd for larch@yhetil.org; Tue, 15 Dec 2020 14:44:24 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:59206) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kpGEr-0006lJ-2f for guix-devel@gnu.org; Tue, 15 Dec 2020 14:44:01 -0500 Received: from mx1.dismail.de ([78.46.223.134]:6118) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kpGEo-0007CA-SA for guix-devel@gnu.org; Tue, 15 Dec 2020 14:44:00 -0500 Received: from mx1.dismail.de (localhost [127.0.0.1]) by mx1.dismail.de (OpenSMTPD) with ESMTP id 4b4e9e81; Tue, 15 Dec 2020 20:43:55 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed; d=dismail.de; h=from:to:cc :subject:references:date:in-reply-to:message-id:mime-version :content-type; s=20190914; bh=1eFZMhZIb38CkDregxpHgO6TUrI6xY1e3k upzOoAI+g=; b=glJ7a33B/gUl0bWkYF/eK2W5bgU+loLaqgRQKUth3nGU3Zo1Tk H+5KAGrSRmFH+UA4Vmg34wsnbsW7SUfdltuZY5U1pofjNzRSVQ/bYkqmoOVMAFgm 4UAHMYKcm6gLqnaVAMAKvKu0QuUaqJTcS+pyXcDptOR1slXdpAJzhuwbMSWhTUTG k89Uv+jDHX0mrv3D5EUmZRtseQn1EByudoGxOq0r0p5waatAbyN83ZGniDO5gp4n zJHO0oruBZmrPVU9a4LrFOsCf9POCRt25RjySlNae279lqbTA+EfL0RFcQhNJIEC gDuOUe2KOLv/y6DUsxEHGp6THz7Q0zbtw00Q== Received: from smtp2.dismail.de ( [10.240.26.12]) by mx1.dismail.de (OpenSMTPD) with ESMTP id 05a869e8; Tue, 15 Dec 2020 20:43:55 +0100 (CET) Received: from smtp2.dismail.de (localhost [127.0.0.1]) by smtp2.dismail.de (OpenSMTPD) with ESMTP id 4a66afb8; Tue, 15 Dec 2020 20:43:55 +0100 (CET) Received: by dismail.de (OpenSMTPD) with ESMTPSA id 23f39ca6 (TLSv1.3:AEAD-AES256-GCM-SHA384:256:NO); Tue, 15 Dec 2020 20:43:54 +0100 (CET) From: Joshua Branson To: Jonathan Brielmaier Subject: Re: When substitute download + decompression is CPU-bound References: <87im94qbby.fsf@gnu.org> <94405d66-b13c-e6e6-e8d5-df23b93e5d97@web.de> Mail-Followup-To: Jonathan Brielmaier , guix-devel@gnu.org Date: Tue, 15 Dec 2020 14:43:51 -0500 In-Reply-To: <94405d66-b13c-e6e6-e8d5-df23b93e5d97@web.de> (Jonathan Brielmaier's message of "Tue, 15 Dec 2020 11:40:10 +0100") Message-ID: <87im92voqw.fsf@dismail.de> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain Received-SPF: pass client-ip=78.46.223.134; envelope-from=jbranso@dismail.de; helo=mx1.dismail.de X-Spam_score_int: -43 X-Spam_score: -4.4 X-Spam_bar: ---- X-Spam_report: (-4.4 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_MED=-2.3, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: guix-devel@gnu.org Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN X-Migadu-Spam-Score: -3.01 Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=dismail.de header.s=20190914 header.b=glJ7a33B; dmarc=pass (policy=reject) header.from=dismail.de; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Migadu-Queue-Id: 9CF64940480 X-Spam-Score: -3.01 X-Migadu-Scanner: scn0.migadu.com X-TUID: PId5Ghh7b4U0 Looking on the Zstandard website (https://facebook.github.io/zstd/), it mentions google's snappy compression library (https://github.com/google/snappy). Snappy has some fairly good benchmarks too: Compressor Ratio Compression Decompress. zstd 2.884 500 MB/s 1660 MB/s snappy 2.073 560 MB/s 1790 MB/s Would snappy be easier to use than Zstandard? -- Joshua Branson Sent from Emacs and Gnus https://gnucode.me https://video.hardlimit.com/accounts/joshua_branson/video-channels https://propernaming.org "You can have whatever you want, as long as you help enough other people get what they want." - Zig Ziglar