From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Arthur Miller Newsgroups: gmane.emacs.devel Subject: Re: Against sqlite3!!! Date: Wed, 08 Dec 2021 07:11:19 +0100 Message-ID: References: <86r1ao34n4.fsf@163.com> <87k0ggmpug.fsf@randomsample> <87y24wfant.fsf@gnus.org> Mime-Version: 1.0 Content-Type: text/plain Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="13598"; mail-complaints-to="usenet@ciao.gmane.io" User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/29.0.50 (gnu/linux) Cc: Qiantan Hong , Zhu Zihao , David Engster , emacs-devel@gnu.org To: Lars Ingebrigtsen Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Wed Dec 08 07:13:39 2021 Return-path: Envelope-to: ged-emacs-devel@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1muqCw-0003Ib-21 for ged-emacs-devel@m.gmane-mx.org; Wed, 08 Dec 2021 07:13:39 +0100 Original-Received: from localhost ([::1]:39980 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1muqCu-0002xT-Fz for ged-emacs-devel@m.gmane-mx.org; Wed, 08 Dec 2021 01:13:36 -0500 Original-Received: from eggs.gnu.org ([209.51.188.92]:55412) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1muqAv-0002D9-3D for emacs-devel@gnu.org; Wed, 08 Dec 2021 01:11:33 -0500 Original-Received: from mail-oln040092071090.outbound.protection.outlook.com ([40.92.71.90]:48513 helo=EUR03-DB5-obe.outbound.protection.outlook.com) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1muqAm-0004b1-Vu for emacs-devel@gnu.org; Wed, 08 Dec 2021 01:11:32 -0500 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=H9jBTeXfR9CjtNhjX0Ehtm7parxJYX2aZKoNHvjrCrrBbc6s/ln0QPJ7fvYHq0FrEi2JOtpxbu9rLKMCYVc2JPcSsCF2AloYKTpNaF2C0dgBN8j5cGuP16uPkEMdUkQIqIbHTL+ujO6Mcy86CzKzeBAiY0/34IV0A2wA/ozv94KHxVJwwCEKUxMkjuZGrI+ov/ooK5w8L4H/VegboQfIupUsV6Wvpjq1p3rt/Ary9772BEwtScCKdGNKM5KrbZGi9+k4y8FQOiClRueW+xP++3G0rUtG7HIbP2Molawz24ASPg/zdv3xHukyaNn19A+q7pUB/CpF8TjVuWazRQYIAw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=3KUVtY2agVinRBdFgsksJpL+3DRqquY2EwnfrGatzeM=; b=HS2ySnTRliiZHQmJ+Esd+B6J6x3WXGugY5mALLi35jes2aKTijUnf51c/jIW2k3lV65Nt57fO+2pQ1JUxDFJhZN9+4Xy48Nh9uksbXNDg30OjpQQcxTtLTHOp7vPEN3IXx8c9ts2t7Yvcy+qBM4KSrKm1jGi4bVyhxHR9Wr8DM+BHXZWiMv1wyOesn1Muq+fjM3eVEsRpiVUlgqXNUMuGU6R2odisahj3L1wH9D9AiVyTOEaZpqCfwihqJt8dnIrVeznhN/Jqlx2x8kN1Fd6SmRQn5OcEGQSmEvb2Q6pFI6dvGHkCIiV3GBNVyDszHT+gMFk1Xfp/ldf7D9xjYJQWA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=live.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=3KUVtY2agVinRBdFgsksJpL+3DRqquY2EwnfrGatzeM=; b=IHiGCCW49685pbhY3PNHzcCGR1SY5Cwq55eGcC+1McYeoMQfYQfw58TcLTNEEY7yhrK95Wksh8or8oyhwKt/p5guciIJEWiwE4mxuqSHEQ7br3WVQ4OnsruLHXxvYRJ241VHUb3Qvkf/LxICLrqkx198cegIN5KBlQhTeppDT9TjyoJ04gbri/kUERF7yeKyFi6wEfjH8iW8hFDRIAX+89pu92mGPnABGBCXbsFYCh9oGtV8+wnMu1dHSLmoMfrD5SOChl/BMov0tdf8MpXWTpqYMlonZ4+FtUlbmhoM/EX/wv/ffHnCIVpqevyAhQTVbT1dplSgTiyAqLCGoflKRQ== Original-Received: from AM9PR09MB4977.eurprd09.prod.outlook.com (2603:10a6:20b:304::20) by AM0PR09MB2465.eurprd09.prod.outlook.com (2603:10a6:208:d6::30) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4755.16; Wed, 8 Dec 2021 06:11:22 +0000 Original-Received: from AM9PR09MB4977.eurprd09.prod.outlook.com ([fe80::b012:5fd9:9447:d64a]) by AM9PR09MB4977.eurprd09.prod.outlook.com ([fe80::b012:5fd9:9447:d64a%4]) with mapi id 15.20.4755.022; Wed, 8 Dec 2021 06:11:22 +0000 In-Reply-To: <87y24wfant.fsf@gnus.org> (Lars Ingebrigtsen's message of "Tue, 07 Dec 2021 21:00:06 +0100") X-TMN: [+P8DiJj5BgE9WziQzs2R82FOXw7LM8uk] X-ClientProxiedBy: AS9PR06CA0365.eurprd06.prod.outlook.com (2603:10a6:20b:460::17) To AM9PR09MB4977.eurprd09.prod.outlook.com (2603:10a6:20b:304::20) X-Microsoft-Original-Message-ID: <87czm7tym0.fsf@live.com> X-MS-Exchange-MessageSentRepresentingType: 1 Original-Received: from pascal.homepc (81.232.177.30) by AS9PR06CA0365.eurprd06.prod.outlook.com (2603:10a6:20b:460::17) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4755.14 via Frontend Transport; Wed, 8 Dec 2021 06:11:19 +0000 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 411be1e3-25b5-4734-e13a-08d9ba118d63 X-MS-TrafficTypeDiagnostic: AM0PR09MB2465:EE_ X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: nbkm94qRPdUWF64uhWtU3pdgYpfdR/wxejey2yfIMWvFn93CJOM4Eb7hZCh1m3LDibxhorpdUbKmzrlRPbAStEVfS510qMExSYra85o3Y2UOXN6BANzQ715OGenq3aXqVzXcSIJaZxmSsZdXDfRe19khGLzhXKQtyB1V0vdL6TZqCaIYcouJnNnlxFDLb/PabzOTgtG+WHtk+I31LRunThHeChBuPbkKueVTG9JdSnEjxH9u52dFYX6PgIc4UTKNFp+WYBORJ26CccjAzKs8WH2T7+hipIGA2CTVi3ZGvqLgj9VoH/Sv2do4IcsLotLr2kIim7g0AMUuqiUXRSNqKPXczLCePGw2Duk1ruMCe4vG3VCpO1uvVcEzw1M1BwaKVbaZv2krspSWwDmzDgUK6Ig9jGSjpJqWOaU/QFbbmNEjXVxFa3jkeg8767SNlDVKgNePoUFmAq/VeDpaGql1xumV0IYPydBm9X3XP9263Yz8E6vNz7C0GHN6me+m4gDqf64lFnAeR4Qip4XqmKW4OOJwnQtPHOMgcXE9rdFf0SHKzavTlZQqmW1lT05jeE+LNdguEYvfk0/rR+3j+/mfbQ== X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?UWmnu8cIT8x5aoRc4jPmyLBe9etYQvG6TEJn/X72q+lgv2d0RAfAAVt34RQA?= =?us-ascii?Q?ZsrTX7Yl8Yu/Zw9A58HkE8Kq6v5GZxMvP1trecVbyhS5RjmsHG4JEv39eFtH?= =?us-ascii?Q?m+v2i6TVRi409Q1LWgKnUiv/jrtkrFmrrfFAqqqau8w68M03zsqwHCs6UsXb?= =?us-ascii?Q?LWrnPsZIj8gqb9WIdSTu542NdO+RVZwXZY2JgpsaSYTbx6E/30EmK3KVMX4a?= =?us-ascii?Q?M/RzPXmhShk/9I0/qi4kz5yWDguQkRhtB/4o/HFZCEuii6Tk9r9alO/5JnjK?= =?us-ascii?Q?kG+1EXXuXick3OUE6zhSQzHGJ8PVldJyq0daI4gpUaPrcev9Zpap/4kSsmfP?= =?us-ascii?Q?cbn2cvUl5njn0o0T0kS4Dzg99EULTE5LNjK4B3m1Rk4D7Aywf/wGgtgoA3Pd?= =?us-ascii?Q?kl1EqnS0UPOEYwLl4SxnWwnvaTf3xCBkoq7qzpLBg/3wo+NDvKf/hC455VjW?= =?us-ascii?Q?CNt5eaeJNKnczc88dBeZ3oUvNX5EA1yO1dSNWudX4eiCvV7o7Ad5cu/ipgKe?= =?us-ascii?Q?XVe/TklqakpBQGnp0OZ6nEd07ptTup3+Hw93JhBz8Cqjc0R6O15uwX+66lvs?= =?us-ascii?Q?yqqh0BX77EGc71kWs9r0eAxxlPSSPZMUvW6tBLs+rV3fODCbSIurM9ozZ9Cs?= =?us-ascii?Q?s4 X-OriginatorOrg: sct-15-20-4755-11-msonline-outlook-64da6.templateTenant X-MS-Exchange-CrossTenant-Network-Message-Id: 411be1e3-25b5-4734-e13a-08d9ba118d63 X-MS-Exchange-CrossTenant-AuthSource: AM9PR09MB4977.eurprd09.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 08 Dec 2021 06:11:22.3404 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM0PR09MB2465 Received-SPF: pass client-ip=40.92.71.90; envelope-from=arthur.miller@live.com; helo=EUR03-DB5-obe.outbound.protection.outlook.com X-Spam_score_int: -10 X-Spam_score: -1.1 X-Spam_bar: - X-Spam_report: (-1.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FORGED_SPF_HELO=1, FREEMAIL_FROM=0.001, MSGID_FROM_MTA_HEADER=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_PASS=-0.001, T_SPF_TEMPERROR=0.01 autolearn=no autolearn_force=no X-Spam_action: no action X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Original-Sender: "Emacs-devel" Xref: news.gmane.io gmane.emacs.devel:281320 Archived-At: Lars Ingebrigtsen writes: > David Engster writes: > >> Yes, and it's slow. The Gnus registry is saved/loaded this way, and this >> has annoyed me for years. > > Yup. The Gnus registry would be well suited to use sqlite directly, > though -- it's basically hand-maintaining a (large) database, and sqlite > is a good fit for that. > > That is, I don't think the new normal persistence method would be ideal > for the registry. > > But, yes, the Gnus registry is a good demonstration of why serialising > hash tables to disk is unworkable in practice. Than implement a way for Emacs to dump lisp objects to files faster. It would be very useful for Emacs in general. You will still have to serialize your gnus db to sqlite db, and write it to disk via sqlite, so disk access will still be there. Have you trye to write it in chunks in idle timer or all in one go? Is that possible?