From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Arthur Miller Newsgroups: gmane.emacs.devel Subject: Re: Against sqlite3!!! Date: Wed, 08 Dec 2021 10:21:48 +0100 Message-ID: References: <86r1ao34n4.fsf@163.com> <87k0ggmpug.fsf@randomsample> <87y24wfant.fsf@gnus.org> <981F36EB-677F-4043-BE09-68226371D7B6@mit.edu> Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="37698"; mail-complaints-to="usenet@ciao.gmane.io" User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/29.0.50 (gnu/linux) Cc: "larsi@gnus.org" , Zhu Zihao , David Engster , "emacs-devel@gnu.org" To: Qiantan Hong Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Wed Dec 08 10:23:28 2021 Return-path: Envelope-to: ged-emacs-devel@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1mutAd-0009fR-W8 for ged-emacs-devel@m.gmane-mx.org; Wed, 08 Dec 2021 10:23:28 +0100 Original-Received: from localhost ([::1]:53234 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1mutAc-0002ej-VD for ged-emacs-devel@m.gmane-mx.org; Wed, 08 Dec 2021 04:23:26 -0500 Original-Received: from eggs.gnu.org ([209.51.188.92]:45722) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mut9H-0001jZ-Fz for emacs-devel@gnu.org; Wed, 08 Dec 2021 04:22:05 -0500 Original-Received: from mail-oln040092069055.outbound.protection.outlook.com ([40.92.69.55]:26886 helo=EUR02-VE1-obe.outbound.protection.outlook.com) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mut9E-00066F-7W for emacs-devel@gnu.org; Wed, 08 Dec 2021 04:22:03 -0500 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=TPw2wSiPIK92yaLvOk93FkS4q5z4duy9nq+Vith1LXKjtE+5R8xZeYxeo1+uhy+iuZwU1AaH0zPrwoQ1T3uNrZE6sAykBamvm4FQtqLdeKAq56oRk3xhz4hxIl9mTsW0y7wkamUXoms2rFdp/01ZgpGKA+TmGMmKuwgEYTCaB3M8MmugExxUpjGkj+GaD5Cm4zqUu/PeIYExipdfVqAOQpYau00qcW2QW5OltHhLU/Q+6Yknt1+nk1jeVT0jrL7sylCZxYwuRHw0ofs2B/yMmmkvZpKwN/NSZPFl2yuW3uSr6YQyclYX7N7tsvEV6rF0gG+wczrHuCixd9HnDEENgQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=/njtQv2OZwuXqveWuQhHtaq0+YBh3YU/RZjj7oarvS8=; b=ZjlcbJ5B5ITufK0IoyEUH7BwD101W1ReCwPWPuZetVWHeEpQGdp5j0cTHpokOhkK0S1gRTzeMoS/TCmEWqOBDJKTnNfSgLEECihp1ZiPWbM7RhY8SHcTEetDNvWTaAzTFUMvePJ9kRQ89SmJzChld7e7UVaCGJHpEL4bYRG+jlYsw4e1J/FYTpeK10fLKSHP/LadLhbkIztMnEK8P/s+7M1CJiLpQRPBefBxaLnGwpMtSdfpFtncEV+63YiIneq0+fNrXBJK/6ggItuIwTHvmib9kyhp9pjQDHg3U+Kv3CwUTwIsMZEU3jFUy3riqf7/cpKaM6YMOBV1EsTh6+1TWw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=live.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=/njtQv2OZwuXqveWuQhHtaq0+YBh3YU/RZjj7oarvS8=; b=rS0dW6xcymOBsf7bTvA0J3g/MZQLA9hxOo4HHxQpIWKOluVU0XZUx34k3xw+LHljZBQB/NeTTh/iMRaeJS5/D1+/q6Zpjf9sMRp00qmAqsBQOGMgMswptQI7IMzc5iolfck/ZUmK1h1DAXr2hD/GwIYBa7DjtWmyI6GN7jEDIfbVw2CDdh8qZprg4MUdrmoPFLo+pzTVjCvcNHczTBKoag/8lOzbl6K5ZhGwibtmmtdZkUp4EBYh9cq/YxAhgATb/ZmoysoGdEWS03+3ULzE+ksZrcyYOvePnvoxFVGvF9/DzW/kHn+IFD2Hz2S6ZXlOn9wRrJAQ9OrnzXlFE6qjFA== Original-Received: from AM9PR09MB4977.eurprd09.prod.outlook.com (2603:10a6:20b:304::20) by AM0PR09MB4434.eurprd09.prod.outlook.com (2603:10a6:20b:16f::13) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4778.13; Wed, 8 Dec 2021 09:21:52 +0000 Original-Received: from AM9PR09MB4977.eurprd09.prod.outlook.com ([fe80::b012:5fd9:9447:d64a]) by AM9PR09MB4977.eurprd09.prod.outlook.com ([fe80::b012:5fd9:9447:d64a%4]) with mapi id 15.20.4755.022; Wed, 8 Dec 2021 09:21:52 +0000 In-Reply-To: <981F36EB-677F-4043-BE09-68226371D7B6@mit.edu> (Qiantan Hong's message of "Wed, 8 Dec 2021 06:20:42 +0000") X-TMN: [L8dPkjOzoYxYjmhyu0O/KPUx48UKHbij] X-ClientProxiedBy: GV3P280CA0080.SWEP280.PROD.OUTLOOK.COM (2603:10a6:150:a::29) To AM9PR09MB4977.eurprd09.prod.outlook.com (2603:10a6:20b:304::20) X-Microsoft-Original-Message-ID: <87zgpbcuz7.fsf@live.com> X-MS-Exchange-MessageSentRepresentingType: 1 Original-Received: from pascal.homepc (81.232.177.30) by GV3P280CA0080.SWEP280.PROD.OUTLOOK.COM (2603:10a6:150:a::29) with Microsoft SMTP Server (version=TLS1_2, cipher=) via Frontend Transport; Wed, 8 Dec 2021 09:21:49 +0000 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 499948d7-a79d-448a-50bf-08d9ba2c2a06 X-MS-TrafficTypeDiagnostic: AM0PR09MB4434:EE_ X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: 4zvOacvdoyEVh6u74wAdpq3Ar0c/tLPN+7M7PBmdktZrGYRpfmlrcRsXuhdOob4wN0Hpotv+N7fpfHEPe/I+jMfCxNCS1GxC93mWDv60dVoCiX5wJxha0Qr1/+VM8PZ5WNjRWcXQygTW+1S1mSoqfoWVC52qybAB+uu8OFo5IyFG0iGb5fk2T4xXGQAmubwOL0Jp3SxDY4N2GZbHMZ+thcHd9ihl2LXxdl97C8sWIgsfINFTbOC3Sy517Jgx8Ud4AQvn8wNDny583ce9oYkwekW2EnukmKeCMl7hVKS9JpM+AT5AmrqocZat9jQpoxgWeoxv7PFfTj/Ltb3x9XQ/wP1AS+yjGy/W7GLyu82ojnOPtSmUfcMn6FQScnPCxIk5JdschIoxsyJW6I2Rrbq1aOKXGt414RmDDpS3oDTRqJlhlgGQ2ntIBYjoOD1QSG4ljCBMxhY3CR39bH0HNeuaJIU3phE/uOUlYuOTlghlNYN/UOta2hlIT0IXo/fieZfoaLxgTUmYHBqqU7E51LYDoC/x7soImcd9GT0fcZZTPNY986yAHyzA+Gvl/QJu5nWYcIUjyYFQfi+8U+TRZicGIw== X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?VjFNeTNoMDg1V2VrVUJueXhTdWFpL3JBeG95K0ZsWFRXUlBNRnpsUmdxS2Rv?= =?utf-8?B?Wng1TWJWR0ovQ1YvVFhHUjAwd0l3T21WZHNjY1ZMUUxFL1pndkk0QjZ3djBY?= =?utf-8?B?Y0xXWjI3SW0wankwQlZjeEJDNWhFVCtLSWFaS3o1ODVkU1RHNVU1bEMvMUVI?= =?utf-8?B?SmZPeFpjakE0YzNuNXZiYTlUZy9KeEZ2VVRqZHk0YlF3K2xwVEh3QWxEZURB?= =?utf-8?B?aHZFbzNvOUZSWmNQenNSaXFPeGtNR3lmQkpJMnNWTlVjUytHMU5BTVB2eUw2?= =?utf-8?B?Ty9RSnRYcStqUzRHQXUxZzJCbEphSGl2bndzVXh0UjdOck9ZOXZFeG5xcndX?= =?utf-8?B?L3FpaWJTSzRWUnFNRGI4alE4bVlOWXhrM2MzZ0c1QTFqZkNQdWc2U3dEUVJW?= =?utf-8?B?MkNBN3d1clhKbXJXeVdpMmtJZWpseDBZTUI1NERrWHBvZnloUFVDc05qUVZa?= =?utf-8?B?aVdIRXZZOFY1TTBkREpMcWpSeTM1WmhBWUNSY0JhRnpBRzVwWS9mNEFOOFRl?= =?utf-8?B?MjQwQXBNTUFuRDQ4RmY0VHBYUDkxVDVTVFdrV05qSzVDNHNqNmdoN011SStk?= =?utf-8?B?Z28vb2VWN0VRb1l0UXJMSDlRalhDeUY2SzNtcnVLVExiMGRWakljODNsdzY5?= =?utf-8?B?NFVBdjlTVVU1Mjl2RlZDa1IvVjN5amw1TkFWd2 X-OriginatorOrg: sct-15-20-4755-11-msonline-outlook-64da6.templateTenant X-MS-Exchange-CrossTenant-Network-Message-Id: 499948d7-a79d-448a-50bf-08d9ba2c2a06 X-MS-Exchange-CrossTenant-AuthSource: AM9PR09MB4977.eurprd09.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 08 Dec 2021 09:21:52.4154 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM0PR09MB4434 Received-SPF: pass client-ip=40.92.69.55; envelope-from=arthur.miller@live.com; helo=EUR02-VE1-obe.outbound.protection.outlook.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, MSGID_FROM_MTA_HEADER=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Original-Sender: "Emacs-devel" Xref: news.gmane.io gmane.emacs.devel:281330 Archived-At: Qiantan Hong writes: >> Than implement a way for Emacs to dump lisp objects to files faster. It = would be >> very useful for Emacs in general. > I think for this question, the one-and-for-all solution is. to have a ful= ly > incremental persistent object store, i.e. all mutation are stored > incrementally without ever needing to print out the =E2=80=9Cfully value= =E2=80=9D > of a Lisp value. What do you think? I am not sure I understand what you mean. What is "fully value" of a Lisp value. You mean entire object? > resist!.el in its current form basically implemented a special case > of the above, where only mutation to the top level hash table=20 > is persisted incrementally. > > I can=E2=80=99t see a way to implement persistent object store without > some non-trivial memory overhead, though (because each > object has to get an unique id). The best thing I can come up > with has to have a hash table that maps every object in the > store to a numeric ID. Is that too much? Honestly, I have no idea. I just meant that it is very useful to be able to serialize/deserialize lis= p ojbects, in general, without need to go through some intermediate key/value database. I don't know what you are doing to start with; I haven't looked at your resist.el, but maybe you can cache keys that needs to be flushed to disk in= some 'dirty state (a list of kyes) and flush just those keys to a file in idle t= imer.