From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: =?utf-8?Q?Gerd_M=C3=B6llmann?= Newsgroups: gmane.emacs.devel Subject: Re: MPS: weak hash tables Date: Sat, 06 Jul 2024 16:52:21 +0200 Message-ID: References: <-plQctKgNkvp-LJ9ov2QAiXQKxd9V-hI0yz_opRGxQtbknubCjH4rH2-ymgbw_Qr1ZhB1rtlmiEW8XtuIVNr7nR_Yj20AH6WkH6kUGp68g0=@protonmail.com> <_mNcR6ailVKpYHLxgfo_tJlYGeR0AQIzQWluspYYp5_g5pIIKkHLNfFkklQQgOKNiVW8jn8NS3i2dJ7_B2Qyx9v-Dq3MQ9mP8HNL30UWsqY=@protonmail.com> <878qyf4sgm.fsf@gmail.com> <878qye3l81.fsf@gmail.com> <86a5iu4tiy.fsf@gnu.org> <87msmu1uy5.fsf@gmail.com> <87cynq1sx0.fsf@gmail.com> Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="13336"; mail-complaints-to="usenet@ciao.gmane.io" User-Agent: Gnus/5.13 (Gnus v5.13) Cc: Eli Zaretskii , pipcet@protonmail.com, emacs-devel@gnu.org To: Helmut Eller Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Sat Jul 06 16:52:57 2024 Return-path: Envelope-to: ged-emacs-devel@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1sQ6mX-0003LP-Ep for ged-emacs-devel@m.gmane-mx.org; Sat, 06 Jul 2024 16:52:57 +0200 Original-Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1sQ6m4-0002z4-JS; Sat, 06 Jul 2024 10:52:28 -0400 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1sQ6m2-0002yu-Kc for emacs-devel@gnu.org; Sat, 06 Jul 2024 10:52:26 -0400 Original-Received: from mail-ed1-x531.google.com ([2a00:1450:4864:20::531]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1sQ6m1-0007rm-5y; Sat, 06 Jul 2024 10:52:26 -0400 Original-Received: by mail-ed1-x531.google.com with SMTP id 4fb4d7f45d1cf-57cc30eaf0aso1498000a12.2; Sat, 06 Jul 2024 07:52:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1720277543; x=1720882343; darn=gnu.org; h=content-transfer-encoding:mime-version:user-agent:message-id:date :references:in-reply-to:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=Af+m2hlLGQUpnJv4nDt9+zD9/O1T/mNtMAvBmu4IIyY=; b=IJ1Lc7gPIOK1ggXrzXMnVteZqCNx+yt0aic5RQY6gwBuTTj9T27IGgfkiMCu/Dpi9+ 52atRTBmidz4i00XtqGFYGhgCoE/UcsgLL2UQdY9c62ATvM5WAvL8A/VC7rLB1XFyW8h IXwtodlibY8JkpogbiQEFi9yrD9NRGT5gBc1a1d2CYDPYHS/rXuxr4DTfGm6HU4NKfds PrsZTtNwPRnuo2c/Jb3smILKYYe3bsCUnk+8twV4kjD9MHoHo++PBEzWHkXE8ebQTwOY CNd7HXp66nOcNJcEIJcqGbsBoB02JsJTwaSN6VTuGCfs5bEH94p1Hujghrb8VCqWNutB pNQA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1720277543; x=1720882343; h=content-transfer-encoding:mime-version:user-agent:message-id:date :references:in-reply-to:subject:cc:to:from:x-gm-message-state:from :to:cc:subject:date:message-id:reply-to; bh=Af+m2hlLGQUpnJv4nDt9+zD9/O1T/mNtMAvBmu4IIyY=; b=t+VaTpPe7of7aZSnBOSgQtDD7ImnCkNCRQVKoBBCxAPv4qxF6UcrJqfMmkdDYDKdHs R/xohe28wFLI1l7V7k9lRoeupqM40HAknwFxKG9OKT6xwYTVAcx9M6L+g6abVqUEQV9b GmalFvy0aM8D2tpCjk9yYpOnd5zyTzaunF5to9bc2Y/gJp4P6jGXYTXukhUC/Oqmvdni 2nnYvmRk+h2kUUpfif/BjMwndsMJy29iLLCDonMsMqctBX9aNZRY71SfJrU6SfOVIned N6xWFPZSCEkD9QZ5MEVfBJ9gVNwVE5CV3A3byoAVYvVK5y0U1+wKtjwjLf2F3ocSlMcM XhzQ== X-Forwarded-Encrypted: i=1; AJvYcCWPCDNTg0A7Qdgj68QSCvnYO+dMzmzDDcbEqTIMAgf8c9LLZC6hanASxjATevVNjZ7aduwQ8cpveEuxexzpXZDJuFVz X-Gm-Message-State: AOJu0Yw6wGkPhWuNYLTAlayzcmhKrvdsLl9oOW2nUlcK8QIEQVrek4D3 EzpVReCNwSsXGk+3J0/k2nCOvvUsaObbTS6mKFnrnqdJI4LobQ1t+cmcJw== X-Google-Smtp-Source: AGHT+IEp6YI05tyj0wfY4q1NdwjHpoFSOgb9x4wxFvI62CGUZ6JtckUpFI71+sSDZyMbja2Yl6KdwA== X-Received: by 2002:a05:6402:40d2:b0:57c:5d4a:4122 with SMTP id 4fb4d7f45d1cf-58e5994d507mr7040606a12.9.1720277542716; Sat, 06 Jul 2024 07:52:22 -0700 (PDT) Original-Received: from pro2.fritz.box (p4fe3a82e.dip0.t-ipconnect.de. [79.227.168.46]) by smtp.gmail.com with ESMTPSA id a640c23a62f3a-a77abd2b5e8sm268192566b.26.2024.07.06.07.52.21 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 06 Jul 2024 07:52:22 -0700 (PDT) In-Reply-To: <87cynq1sx0.fsf@gmail.com> (Helmut Eller's message of "Sat, 06 Jul 2024 16:44:43 +0200") Received-SPF: pass client-ip=2a00:1450:4864:20::531; envelope-from=gerd.moellmann@gmail.com; helo=mail-ed1-x531.google.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Original-Sender: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Xref: news.gmane.io gmane.emacs.devel:321442 Archived-At: Helmut Eller writes: > On Sat, Jul 06 2024, Gerd M=C3=B6llmann wrote: > >>> finishes and requires 41.82 seconds compared to the 12.26 of the non-MPS >>> version. And it uses something like 2.8 GB compared to 350 MB of the >>> non-MPS version (estimated by looking at the RES column in top). > > Scratch that. That had some MPS_KEY_COMMIT_LIMIT in there. > >> So 1000 is probably to high for that that use case, or 0.1s is too low, >> especially in batch mode. Grmpf. Could you try with 100 instead of 1000? > > This is should be better: > > N Seconds RES > 1 65.10 920MB > 10 49.59 1GB > 50 45.75 1.4GB > 100 43.50 2.8GB > 500 42.14 2.6GB > 1000 41.98 2.6GB > > As before the RES column is what I saw in top (sampled every 3 seconds). Thanks! I've made it so that in batch mode we don't put a time limit on processing messages because that made no sense. Hm. Don't know how to do better at the moement. The message passing itself is of course costly.