From mboxrd@z Thu Jan 1 00:00:00 1970 From: Pjotr Prins Subject: Re: /gnu/store/.links/ Date: Fri, 9 Feb 2018 15:24:00 +0100 Message-ID: <20180209142400.GA6348@thebird.nl> References: <20180209112214.GA5316@thebird.nl> <87d11e747o.fsf@elephly.net> Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Return-path: Received: from eggs.gnu.org ([2001:4830:134:3::10]:55429) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1ek9eQ-0000IS-JA for guix-devel@gnu.org; Fri, 09 Feb 2018 09:27:43 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1ek9eM-0000Fl-KR for guix-devel@gnu.org; Fri, 09 Feb 2018 09:27:42 -0500 Received: from mail.thebird.nl ([95.154.246.10]:53162) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1ek9eM-0000FH-Eu for guix-devel@gnu.org; Fri, 09 Feb 2018 09:27:38 -0500 Content-Disposition: inline In-Reply-To: <87d11e747o.fsf@elephly.net> List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+gcggd-guix-devel=m.gmane.org@gnu.org Sender: "Guix-devel" To: Ricardo Wurmus Cc: Guix-devel On Fri, Feb 09, 2018 at 01:11:23PM +0100, Ricardo Wurmus wrote: >=20 > Hi Pjotr, >=20 > > What is > > > > ls -1 /gnu/store/.links/|wc -l > > 495938 > > > > Never saw it before. Does this scale? >=20 > It=E2=80=99s used for optional file deduplication. It is enabled by de= fault, > but you can disable it with a daemon option on file systems that > deduplicate data at the block level. Hmmm. I think this is better handled at the file system level if people want deduplication. These systems will be more common. > I don=E2=80=99t know about scalability. This number is still well belo= w the > limits of ext4 file systems, but accessing a big directory listing like > that can be slow. I would feel a little better about this if we split > it up into different prefix directories (like it=E2=80=99s done for bro= wser > caches). I don=E2=80=99t think it=E2=80=99s necessary, though. For ext4 it is going to be an issue. Anyway, we'll see what happens. Thanks for explaining. Pj.