* is there a way to serialize hash tables? @ 2020-12-26 3:27 Tim Meehan 2020-12-26 4:28 ` John Cowan 2020-12-26 11:13 ` tomas 0 siblings, 2 replies; 8+ messages in thread From: Tim Meehan @ 2020-12-26 3:27 UTC (permalink / raw) To: guile-user I have a big-ish blob of key-value pairs that I would like to not have to store as text and then convert to a hashtable when I am filtering my data. Right now I am saving it as an alist and then converting back to a hashtable using "alist->hashtable" from SRFI 69. I was just hoping that there was something more clever ... perhaps it is plenty clever enough. ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: is there a way to serialize hash tables? 2020-12-26 3:27 is there a way to serialize hash tables? Tim Meehan @ 2020-12-26 4:28 ` John Cowan 2020-12-26 12:10 ` Linus Björnstam 2020-12-26 11:13 ` tomas 1 sibling, 1 reply; 8+ messages in thread From: John Cowan @ 2020-12-26 4:28 UTC (permalink / raw) To: Tim Meehan; +Cc: guile-user I think that's the best bet, although JSON is also a possibility. I'm working on a more general text-serialization solution, but it will be quite some time before I have a chance to work on it. On Fri, Dec 25, 2020 at 10:28 PM Tim Meehan <btmeehan@gmail.com> wrote: > I have a big-ish blob of key-value pairs that I would like to not have to > store as text and then convert to a hashtable when I am filtering my data. > > Right now I am saving it as an alist and then converting back to a > hashtable using "alist->hashtable" from SRFI 69. I was just hoping that > there was something more clever ... perhaps it is plenty clever enough. > ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: is there a way to serialize hash tables? 2020-12-26 4:28 ` John Cowan @ 2020-12-26 12:10 ` Linus Björnstam 2020-12-27 5:58 ` Tim Meehan 2020-12-29 23:18 ` Aleix Conchillo Flaqué 0 siblings, 2 replies; 8+ messages in thread From: Linus Björnstam @ 2020-12-26 12:10 UTC (permalink / raw) To: John Cowan, Tim Meehan; +Cc: guile-user Alex and I got the speed of guile-json up to about 19megs a second under guile 3 on a 4 year old intel i5, which may or may not be adequate for your needs, Tim. I have some code I wrote during that spurt that preforms slightly better than guile-json in general (about 3-4% on my machine. Alex could not repeat those numbers) an on files with many large strings in particular (10% in extreme cases). If that is interesting I could put it online somewhere. The functioning code is a derivate work of guile-json, so the GPL applies. -- Linus Björnstam On Sat, 26 Dec 2020, at 05:28, John Cowan wrote: > I think that's the best bet, although JSON is also a possibility. I'm > working on a more general text-serialization solution, but it will be quite > some time before I have a chance to work on it. > > On Fri, Dec 25, 2020 at 10:28 PM Tim Meehan <btmeehan@gmail.com> wrote: > > > I have a big-ish blob of key-value pairs that I would like to not have to > > store as text and then convert to a hashtable when I am filtering my data. > > > > Right now I am saving it as an alist and then converting back to a > > hashtable using "alist->hashtable" from SRFI 69. I was just hoping that > > there was something more clever ... perhaps it is plenty clever enough. > > > ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: is there a way to serialize hash tables? 2020-12-26 12:10 ` Linus Björnstam @ 2020-12-27 5:58 ` Tim Meehan 2020-12-29 23:18 ` Aleix Conchillo Flaqué 1 sibling, 0 replies; 8+ messages in thread From: Tim Meehan @ 2020-12-27 5:58 UTC (permalink / raw) Cc: guile-user Thanks a lot guys - I did a test with the stored alist and it was plenty fast enough for what I needed. I had looked at guile-json for reading in some settings. It is good to know that it is very fast also. On Sat, Dec 26, 2020 at 6:10 AM Linus Björnstam <linus.internet@fastmail.se> wrote: > Alex and I got the speed of guile-json up to about 19megs a second under > guile 3 on a 4 year old intel i5, which may or may not be adequate for your > needs, Tim. > > I have some code I wrote during that spurt that preforms slightly better > than guile-json in general (about 3-4% on my machine. Alex could not repeat > those numbers) an on files with many large strings in particular (10% in > extreme cases). If that is interesting I could put it online somewhere. > The functioning code is a derivate work of guile-json, so the GPL applies. > > -- > Linus Björnstam > > On Sat, 26 Dec 2020, at 05:28, John Cowan wrote: > > I think that's the best bet, although JSON is also a possibility. I'm > > working on a more general text-serialization solution, but it will be > quite > > some time before I have a chance to work on it. > > > > On Fri, Dec 25, 2020 at 10:28 PM Tim Meehan <btmeehan@gmail.com> wrote: > > > > > I have a big-ish blob of key-value pairs that I would like to not have > to > > > store as text and then convert to a hashtable when I am filtering my > data. > > > > > > Right now I am saving it as an alist and then converting back to a > > > hashtable using "alist->hashtable" from SRFI 69. I was just hoping that > > > there was something more clever ... perhaps it is plenty clever enough. > > > > > > ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: is there a way to serialize hash tables? 2020-12-26 12:10 ` Linus Björnstam 2020-12-27 5:58 ` Tim Meehan @ 2020-12-29 23:18 ` Aleix Conchillo Flaqué 2020-12-30 8:48 ` Linus Björnstam 1 sibling, 1 reply; 8+ messages in thread From: Aleix Conchillo Flaqué @ 2020-12-29 23:18 UTC (permalink / raw) To: Linus Björnstam; +Cc: guile-user You almost got it right Linus, it's Aleix. :-) For the curious, it sounds something like "Alaish" or here in the US most people can pronounce it as "Alesh". But more accurately [aleʃ] ( https://en.m.wikipedia.org/wiki/Help:IPA/Catalan) Anyways, happy hacking and happy New Year to everyone! Aleix On Sat, Dec 26, 2020, 4:10 AM Linus Björnstam <linus.internet@fastmail.se> wrote: > Alex and I got the speed of guile-json up to about 19megs a second under > guile 3 on a 4 year old intel i5, which may or may not be adequate for your > needs, Tim. > > I have some code I wrote during that spurt that preforms slightly better > than guile-json in general (about 3-4% on my machine. Alex could not repeat > those numbers) an on files with many large strings in particular (10% in > extreme cases). If that is interesting I could put it online somewhere. > The functioning code is a derivate work of guile-json, so the GPL applies. > > -- > Linus Björnstam > > On Sat, 26 Dec 2020, at 05:28, John Cowan wrote: > > I think that's the best bet, although JSON is also a possibility. I'm > > working on a more general text-serialization solution, but it will be > quite > > some time before I have a chance to work on it. > > > > On Fri, Dec 25, 2020 at 10:28 PM Tim Meehan <btmeehan@gmail.com> wrote: > > > > > I have a big-ish blob of key-value pairs that I would like to not have > to > > > store as text and then convert to a hashtable when I am filtering my > data. > > > > > > Right now I am saving it as an alist and then converting back to a > > > hashtable using "alist->hashtable" from SRFI 69. I was just hoping that > > > there was something more clever ... perhaps it is plenty clever enough. > > > > > > > ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: is there a way to serialize hash tables? 2020-12-29 23:18 ` Aleix Conchillo Flaqué @ 2020-12-30 8:48 ` Linus Björnstam 2020-12-30 17:19 ` Aleix Conchillo Flaqué 0 siblings, 1 reply; 8+ messages in thread From: Linus Björnstam @ 2020-12-30 8:48 UTC (permalink / raw) To: Aleix Conchillo Flaqué; +Cc: guile-user I have added it to my phone's dictionary, but for some reason it still autocorrects to Alex. Sorry about that. I know very well that it is Aleix. I remember I had the same problem last time. -- Linus Björnstam On Wed, 30 Dec 2020, at 00:18, Aleix Conchillo Flaqué wrote: > You almost got it right Linus, it's Aleix. :-) > > For the curious, it sounds something like "Alaish" or here in the US > most people can pronounce it as "Alesh". But more accurately [aleʃ] > (https://en.m.wikipedia.org/wiki/Help:IPA/Catalan) > > Anyways, happy hacking and happy New Year to everyone! > > Aleix > > On Sat, Dec 26, 2020, 4:10 AM Linus Björnstam > <linus.internet@fastmail.se> wrote: > > Alex and I got the speed of guile-json up to about 19megs a second under guile 3 on a 4 year old intel i5, which may or may not be adequate for your needs, Tim. > > > > I have some code I wrote during that spurt that preforms slightly better than guile-json in general (about 3-4% on my machine. Alex could not repeat those numbers) an on files with many large strings in particular (10% in extreme cases). If that is interesting I could put it online somewhere. The functioning code is a derivate work of guile-json, so the GPL applies. > > > > -- > > Linus Björnstam > > > > On Sat, 26 Dec 2020, at 05:28, John Cowan wrote: > > > I think that's the best bet, although JSON is also a possibility. I'm > > > working on a more general text-serialization solution, but it will be quite > > > some time before I have a chance to work on it. > > > > > > On Fri, Dec 25, 2020 at 10:28 PM Tim Meehan <btmeehan@gmail.com> wrote: > > > > > > > I have a big-ish blob of key-value pairs that I would like to not have to > > > > store as text and then convert to a hashtable when I am filtering my data. > > > > > > > > Right now I am saving it as an alist and then converting back to a > > > > hashtable using "alist->hashtable" from SRFI 69. I was just hoping that > > > > there was something more clever ... perhaps it is plenty clever enough. > > > > > > > > > ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: is there a way to serialize hash tables? 2020-12-30 8:48 ` Linus Björnstam @ 2020-12-30 17:19 ` Aleix Conchillo Flaqué 0 siblings, 0 replies; 8+ messages in thread From: Aleix Conchillo Flaqué @ 2020-12-30 17:19 UTC (permalink / raw) To: Linus Björnstam; +Cc: guile-user No worries at all :-). I know you know. I just took the opportunity to explain how it is pronounced, I'm aware most people don't know. Best, Aleix On Wed, Dec 30, 2020, 12:48 AM Linus Björnstam <linus.internet@fastmail.se> wrote: > I have added it to my phone's dictionary, but for some reason it still > autocorrects to Alex. Sorry about that. I know very well that it is Aleix. > > I remember I had the same problem last time. > > -- > Linus Björnstam > > On Wed, 30 Dec 2020, at 00:18, Aleix Conchillo Flaqué wrote: > > You almost got it right Linus, it's Aleix. :-) > > > > For the curious, it sounds something like "Alaish" or here in the US > > most people can pronounce it as "Alesh". But more accurately [aleʃ] > > (https://en.m.wikipedia.org/wiki/Help:IPA/Catalan) > > > > Anyways, happy hacking and happy New Year to everyone! > > > > Aleix > > > > On Sat, Dec 26, 2020, 4:10 AM Linus Björnstam > > <linus.internet@fastmail.se> wrote: > > > Alex and I got the speed of guile-json up to about 19megs a second > under guile 3 on a 4 year old intel i5, which may or may not be adequate > for your needs, Tim. > > > > > > I have some code I wrote during that spurt that preforms slightly > better than guile-json in general (about 3-4% on my machine. Alex could not > repeat those numbers) an on files with many large strings in particular > (10% in extreme cases). If that is interesting I could put it online > somewhere. The functioning code is a derivate work of guile-json, so the > GPL applies. > > > > > > -- > > > Linus Björnstam > > > > > > On Sat, 26 Dec 2020, at 05:28, John Cowan wrote: > > > > I think that's the best bet, although JSON is also a possibility. > I'm > > > > working on a more general text-serialization solution, but it will > be quite > > > > some time before I have a chance to work on it. > > > > > > > > On Fri, Dec 25, 2020 at 10:28 PM Tim Meehan <btmeehan@gmail.com> > wrote: > > > > > > > > > I have a big-ish blob of key-value pairs that I would like to not > have to > > > > > store as text and then convert to a hashtable when I am filtering > my data. > > > > > > > > > > Right now I am saving it as an alist and then converting back to a > > > > > hashtable using "alist->hashtable" from SRFI 69. I was just hoping > that > > > > > there was something more clever ... perhaps it is plenty clever > enough. > > > > > > > > > > > > > ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: is there a way to serialize hash tables? 2020-12-26 3:27 is there a way to serialize hash tables? Tim Meehan 2020-12-26 4:28 ` John Cowan @ 2020-12-26 11:13 ` tomas 1 sibling, 0 replies; 8+ messages in thread From: tomas @ 2020-12-26 11:13 UTC (permalink / raw) To: guile-user [-- Attachment #1: Type: text/plain, Size: 757 bytes --] On Fri, Dec 25, 2020 at 09:27:49PM -0600, Tim Meehan wrote: > I have a big-ish blob of key-value pairs that I would like to not have to > store as text and then convert to a hashtable when I am filtering my data. > > Right now I am saving it as an alist and then converting back to a > hashtable using "alist->hashtable" from SRFI 69. I was just hoping that > there was something more clever ... perhaps it is plenty clever enough. If that "dumping/restoring" seems too expensive (have you measured it?), then another alternative might be to use "external" dictionaries, like guile-dbm [1] or guile-wiredtiger [2] Cheers [1] https://www.gnuvola.org/software/guile-gdbm/ [2] https://guix.gnu.org/packages/guile-wiredtiger-0.7.0/ - t [-- Attachment #2: Digital signature --] [-- Type: application/pgp-signature, Size: 198 bytes --] ^ permalink raw reply [flat|nested] 8+ messages in thread
end of thread, other threads:[~2020-12-30 17:19 UTC | newest] Thread overview: 8+ messages (download: mbox.gz / follow: Atom feed) -- links below jump to the message on this page -- 2020-12-26 3:27 is there a way to serialize hash tables? Tim Meehan 2020-12-26 4:28 ` John Cowan 2020-12-26 12:10 ` Linus Björnstam 2020-12-27 5:58 ` Tim Meehan 2020-12-29 23:18 ` Aleix Conchillo Flaqué 2020-12-30 8:48 ` Linus Björnstam 2020-12-30 17:19 ` Aleix Conchillo Flaqué 2020-12-26 11:13 ` tomas
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).