From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <e@80x24.org>
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on dcvr.yhbt.net
X-Spam-Level: 
X-Spam-ASN:  
X-Spam-Status: No, score=-4.2 required=3.0 tests=ALL_TRUSTED,AWL,BAYES_00,
	DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF shortcircuit=no
	autolearn=ham autolearn_force=no version=3.4.6
Received: from localhost (dcvr.yhbt.net [127.0.0.1])
	by dcvr.yhbt.net (Postfix) with ESMTP id D93B41F44D;
	Mon,  8 Apr 2024 23:58:31 +0000 (UTC)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=80x24.org;
	s=selector1; t=1712620712;
	bh=FXMURmrwsbSIOeCzzO3Eo3aq+6QWqvLgWykztdJnhXI=;
	h=Date:From:To:Cc:Subject:References:In-Reply-To:From;
	b=YrvnqBZpaaC+9v+DeebAPXDGE724kL7X7gN/Yoc/qRxMlNOmqAV98Bh65ByppWJ68
	 sjCiyk9A7Sxj+Zi6K+J0GZInIFeTzOV2RsUtXzmZx6Dz3BdsF2Z8Xa8jBmNfuLuOd/
	 bdg8OQmxZ1Nwr+UJRXh/Y4LylHioroHoTD6JjjRU=
Date: Mon, 8 Apr 2024 23:58:31 +0000
From: Eric Wong <e@80x24.org>
To: Konstantin Ryabitsev <konstantin@linuxfoundation.org>
Cc: meta@public-inbox.org
Subject: Re: sample robots.txt to reduce WWW load
Message-ID: <20240408235831.M464581@dcvr>
References: <20240401132145.M567778@dcvr>
 <20240403-able-meticulous-narwhal-aeea54@lemur>
 <20240403223144.M651128@dcvr>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Disposition: inline
In-Reply-To: <20240403223144.M651128@dcvr>
List-Id: <meta.public-inbox.org>

Eric Wong <e@80x24.org> wrote:
> I've unleashed the bots again and let them run rampant on the
> https://80x24.org/lore/ HTML pages.  Will need to add malloc
> tracing on my own to generate reproducible results to prove it's
> worth adding to glibc malloc...

Unfortunately, mwrap w/ tracing is expensive enough to affect
memory use:  slower request/response processing due to slower
malloc means larger queues build up.

Going to have to figure out lower-overhead tracing mechanisms if
I actually want to prove size classes work to reduce
fragmentation....