* Opposition to new single-letter package name "t" @ 2021-03-09 5:27 Mark H Weaver 2021-03-09 5:39 ` Raghav Gururajan 2021-03-09 5:47 ` jgart 0 siblings, 2 replies; 15+ messages in thread From: Mark H Weaver @ 2021-03-09 5:27 UTC (permalink / raw) To: guix-devel; +Cc: LibreMiami, Nicolas Goaziou Hello Guix, Yesterday, an obscure package called "t" was added to Guix. We should reject such short package names in Guix unless there's a very compelling reason to keep them. The problem with single-letter package names is that the probability of collisions is far too high. Due to the so-called "birthday paradox", it only takes 5 such package names before the probability of a collision gets close to 50%. Given this, it's an act of extraordinary hubris to claim a single-letter name for one's package. We've already had at least one collision involving 2-letter names. It takes 26 such names before the probability of collision reaches ~50%. A few years ago, someone wrote a tool based on Guile for "programmatic computer-aided design" and called it "Ao". It turns out that name is already taken by a cross platform audio library which is in Guix. We have precedent for renaming single-letter package names in Guix. We have already changed "s" to "s-shell", and "v" to "vlang". Let's choose a longer name for "t". Here's the package definition: --8<---------------cut here---------------start------------->8--- (define-public t ;; Last release is more than 10 years old. Using latest commit. (let ((changeset "89ad444c000b") (revision "97")) (package (name "t") (version (git-version "1.2.0" revision changeset)) (source (origin (method hg-fetch) (uri (hg-reference (url "https://hg.stevelosh.com/t") (changeset changeset))) (file-name (string-append name "-" version "-checkout")) (sha256 (base32 "0c8zn7l0xq65wp07h7mxnb5ww56d1443l2vkjvx5sj6wpcchfn0s")))) (build-system python-build-system) (native-inputs `(("python-cram" ,python-cram))) (synopsis "Command-line todo list manager") (description "@command{t} is a command-line todo list manager for people that want to finish tasks, not organize them.") (home-page "https://stevelosh.com/projects/t/") (license license:expat)))) --8<---------------cut here---------------end--------------->8--- Any suggestions for a longer name? Maybe "t-organizer" or "t-todo-list-manager"? Note that I'm not proposing to change the name of the executable, since that only affects users who have chosen to install the package, and naturally such users will want to minimize their typing when using the program. I merely propose to change the Scheme variable name and the 'name' field of the package. Thoughts? Regards, Mark ^ permalink raw reply [flat|nested] 15+ messages in thread
* Re: Opposition to new single-letter package name "t" 2021-03-09 5:27 Opposition to new single-letter package name "t" Mark H Weaver @ 2021-03-09 5:39 ` Raghav Gururajan 2021-03-09 5:47 ` jgart 1 sibling, 0 replies; 15+ messages in thread From: Raghav Gururajan @ 2021-03-09 5:39 UTC (permalink / raw) To: Mark H Weaver, guix-devel; +Cc: LibreMiami, Nicolas Goaziou [-- Attachment #1.1: Type: text/plain, Size: 1333 bytes --] Hi Mark! > Yesterday, an obscure package called "t" was added to Guix. We should > reject such short package names in Guix unless there's a very compelling > reason to keep them. > > The problem with single-letter package names is that the probability of > collisions is far too high. Due to the so-called "birthday paradox", it > only takes 5 such package names before the probability of a collision > gets close to 50%. Given this, it's an act of extraordinary hubris to > claim a single-letter name for one's package. > > We've already had at least one collision involving 2-letter names. It > takes 26 such names before the probability of collision reaches ~50%. A > few years ago, someone wrote a tool based on Guile for "programmatic > computer-aided design" and called it "Ao". It turns out that name is > already taken by a cross platform audio library which is in Guix. > > We have precedent for renaming single-letter package names in Guix. We > have already changed "s" to "s-shell", and "v" to "vlang". Let's choose > a longer name for "t". Here's the package definition: Makes complete sense. Thanks for bringing it to our attention. :-) > Any suggestions for a longer name? Maybe "t-organizer" or > "t-todo-list-manager"? How about t-cli? @Jorge WDYT? Regards, RG. [-- Attachment #2: OpenPGP digital signature --] [-- Type: application/pgp-signature, Size: 236 bytes --] ^ permalink raw reply [flat|nested] 15+ messages in thread
* Re: Opposition to new single-letter package name "t" 2021-03-09 5:27 Opposition to new single-letter package name "t" Mark H Weaver 2021-03-09 5:39 ` Raghav Gururajan @ 2021-03-09 5:47 ` jgart 2021-03-09 6:08 ` Raghav Gururajan 1 sibling, 1 reply; 15+ messages in thread From: jgart @ 2021-03-09 5:47 UTC (permalink / raw) To: Raghav Gururajan, Mark H Weaver, guix-devel; +Cc: LibreMiami, Nicolas Goaziou Hi Everyone! > Maybe "t-organizer" or "t-todo-list-manager"? I like Mark's suggestion of "t-todo-list-manager" as well as Raghav's suggestion for "t-cli"; in that order. Either name sounds good to me, though. best regards, jgart libremiami.org search.libremiami.org March 9, 2021 12:39 AM, "Raghav Gururajan" <rg@raghavgururajan.name> wrote: > Hi Mark! > >> Yesterday, an obscure package called "t" was added to Guix. We should >> reject such short package names in Guix unless there's a very compelling >> reason to keep them. >> >> The problem with single-letter package names is that the probability of >> collisions is far too high. Due to the so-called "birthday paradox", it >> only takes 5 such package names before the probability of a collision >> gets close to 50%. Given this, it's an act of extraordinary hubris to >> claim a single-letter name for one's package. >> >> We've already had at least one collision involving 2-letter names. It >> takes 26 such names before the probability of collision reaches ~50%. A >> few years ago, someone wrote a tool based on Guile for "programmatic >> computer-aided design" and called it "Ao". It turns out that name is >> already taken by a cross platform audio library which is in Guix. >> >> We have precedent for renaming single-letter package names in Guix. We >> have already changed "s" to "s-shell", and "v" to "vlang". Let's choose >> a longer name for "t". Here's the package definition: > > Makes complete sense. Thanks for bringing it to our attention. :-) > >> Any suggestions for a longer name? Maybe "t-organizer" or >> "t-todo-list-manager"? > > How about t-cli? > > @Jorge WDYT? > > Regards, > RG. ^ permalink raw reply [flat|nested] 15+ messages in thread
* Re: Opposition to new single-letter package name "t" 2021-03-09 5:47 ` jgart @ 2021-03-09 6:08 ` Raghav Gururajan 2021-03-09 9:35 ` Leo Prikler 2021-03-09 11:38 ` Tobias Geerinckx-Rice 0 siblings, 2 replies; 15+ messages in thread From: Raghav Gururajan @ 2021-03-09 6:08 UTC (permalink / raw) To: jgart, Mark H Weaver, guix-devel; +Cc: LibreMiami, Nicolas Goaziou [-- Attachment #1.1.1: Type: text/plain, Size: 337 bytes --] > I like Mark's suggestion of "t-todo-list-manager" as well as Raghav's suggestion for "t-cli"; in that order. > > Either name sounds good to me, though. Cool! Since, we already mention "todo list manager" in description, I think "ti-cli" is better. @Nicolas Could you merge the attached patch please? Regards, RG. [-- Attachment #1.1.2: 0001-gnu-Rename-t-to-t-cli.patch --] [-- Type: text/x-patch, Size: 1017 bytes --] From 0b3f82c8c8b0685583e99b6c3e48e1f0c22a7706 Mon Sep 17 00:00:00 2001 From: Raghav Gururajan <rg@raghavgururajan.name> Date: Tue, 9 Mar 2021 01:03:32 -0500 Subject: [PATCH] gnu: Rename "t" to "t-cli". * gnu/packages/task-management.scm (t): Rename to t-cli. --- gnu/packages/task-management.scm | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/gnu/packages/task-management.scm b/gnu/packages/task-management.scm index 9667df6030..dfad07b32b 100644 --- a/gnu/packages/task-management.scm +++ b/gnu/packages/task-management.scm @@ -44,12 +44,12 @@ #:use-module (guix build-system meson) #:use-module (guix build-system python)) -(define-public t +(define-public t-cli ;; Last release is more than 10 years old. Using latest commit. (let ((changeset "89ad444c000b") (revision "97")) (package - (name "t") + (name "t-cli") (version (git-version "1.2.0" revision changeset)) (source (origin -- 2.30.1 [-- Attachment #2: OpenPGP digital signature --] [-- Type: application/pgp-signature, Size: 236 bytes --] ^ permalink raw reply related [flat|nested] 15+ messages in thread
* Re: Opposition to new single-letter package name "t" 2021-03-09 6:08 ` Raghav Gururajan @ 2021-03-09 9:35 ` Leo Prikler 2021-03-09 11:38 ` Tobias Geerinckx-Rice 1 sibling, 0 replies; 15+ messages in thread From: Leo Prikler @ 2021-03-09 9:35 UTC (permalink / raw) To: Raghav Gururajan, jgart, Mark H Weaver, guix-devel Cc: LibreMiami, Nicolas Goaziou Am Dienstag, den 09.03.2021, 01:08 -0500 schrieb Raghav Gururajan: > > I like Mark's suggestion of "t-todo-list-manager" as well as > > Raghav's suggestion for "t-cli"; in that order. > > > > Either name sounds good to me, though. > > Cool! > > Since, we already mention "todo list manager" in description, I > think > "ti-cli" is better. I personally disagree. Let's assume we do have a collision and the other program also happens to be a CLI – then we're back to square one. Also, assuming it is a GUI instead of a CLI and the package can be named "t-gui", there will be the implication that the two are related when they need not be. On a related note, the description treads awfully close to advertising territory. I'd say "t-todo-list-manager", perhaps shortened to "t-todos". Alternatively, we might borrow some bits from the go-build-system convention and name it com-stevelosh-t. Regards, Leo ^ permalink raw reply [flat|nested] 15+ messages in thread
* Re: Opposition to new single-letter package name "t" 2021-03-09 6:08 ` Raghav Gururajan 2021-03-09 9:35 ` Leo Prikler @ 2021-03-09 11:38 ` Tobias Geerinckx-Rice 2021-03-09 11:40 ` Julien Lepiller ` (2 more replies) 1 sibling, 3 replies; 15+ messages in thread From: Tobias Geerinckx-Rice @ 2021-03-09 11:38 UTC (permalink / raw) To: Raghav Gururajan Cc: jgart, Mark H Weaver, LibreMiami, Nicolas Goaziou, guix-devel [-- Attachment #1: Type: text/plain, Size: 778 bytes --] Raghav Gururajan 写道: > Since, we already mention "todo list manager" in description, I > think > "ti-cli" is better. It says nothing about the package and does not uniquely identify it: bundlerApp { pname = "t"; [...] meta = with lib; { description = "A command-line power tool for Twitter"; homepage = "http://sferik.github.io/t/"; [...] }; } It's “t”! It's “CLI”! It's... a totally different package[0]! Please: t-todo-manager (t-todo-whatever, I don't care) or $something_a_mainstream_distro_uses, but not yet another bikeshedded unique name, fun as they are to do. Kind regards, T G-R [0]: https://github.com/NixOS/nixpkgs/blob/release-20.09/pkgs/tools/misc/t/default.nix [-- Attachment #2: signature.asc --] [-- Type: application/pgp-signature, Size: 247 bytes --] ^ permalink raw reply [flat|nested] 15+ messages in thread
* Re: Opposition to new single-letter package name "t" 2021-03-09 11:38 ` Tobias Geerinckx-Rice @ 2021-03-09 11:40 ` Julien Lepiller 2021-03-09 13:09 ` Ricardo Wurmus 2021-03-09 12:40 ` Raghav Gururajan 2021-03-09 13:32 ` Search improvements (Was: Opposition to new single-letter package name "t") Taylan Kammer 2 siblings, 1 reply; 15+ messages in thread From: Julien Lepiller @ 2021-03-09 11:40 UTC (permalink / raw) To: guix-devel [-- Attachment #1: Type: text/plain, Size: 1017 bytes --] Well, python-t should be unique, right? There can't be a collision on pypi. Well, except if that package is not on pypi? Le 9 mars 2021 06:38:04 GMT-05:00, Tobias Geerinckx-Rice <me@tobias.gr> a écrit : >Raghav Gururajan 写道: >> Since, we already mention "todo list manager" in description, I >> think >> "ti-cli" is better. > >It says nothing about the package and does not uniquely identify >it: > > bundlerApp { > pname = "t"; > [...] > > meta = with lib; { > description = "A command-line power tool for Twitter"; > homepage = "http://sferik.github.io/t/"; > [...] > }; > } > >It's “t”! It's “CLI”! It's... a totally different package[0]! > >Please: t-todo-manager (t-todo-whatever, I don't care) or >$something_a_mainstream_distro_uses, but not yet another >bikeshedded unique name, fun as they are to do. > >Kind regards, > >T G-R > >[0]: >https://github.com/NixOS/nixpkgs/blob/release-20.09/pkgs/tools/misc/t/default.nix [-- Attachment #2: Type: text/html, Size: 1517 bytes --] ^ permalink raw reply [flat|nested] 15+ messages in thread
* Re: Opposition to new single-letter package name "t" 2021-03-09 11:40 ` Julien Lepiller @ 2021-03-09 13:09 ` Ricardo Wurmus 0 siblings, 0 replies; 15+ messages in thread From: Ricardo Wurmus @ 2021-03-09 13:09 UTC (permalink / raw) To: Julien Lepiller; +Cc: guix-devel Julien Lepiller <julien@lepiller.eu> writes: > Well, python-t should be unique, right? There can't be a collision on pypi. Well, except if that package is not on pypi? Since it’s not a library we shouldn’t name it “python-<anything>”. I agree with Tobias and others who suggested “t-todo-manager” or similar; not “t-cli”, please. -- Ricardo ^ permalink raw reply [flat|nested] 15+ messages in thread
* Re: Opposition to new single-letter package name "t" 2021-03-09 11:38 ` Tobias Geerinckx-Rice 2021-03-09 11:40 ` Julien Lepiller @ 2021-03-09 12:40 ` Raghav Gururajan 2021-03-09 18:12 ` Nicolas Goaziou 2021-03-09 13:32 ` Search improvements (Was: Opposition to new single-letter package name "t") Taylan Kammer 2 siblings, 1 reply; 15+ messages in thread From: Raghav Gururajan @ 2021-03-09 12:40 UTC (permalink / raw) To: Tobias Geerinckx-Rice Cc: jgart, Mark H Weaver, LibreMiami, Nicolas Goaziou, guix-devel [-- Attachment #1.1.1: Type: text/plain, Size: 248 bytes --] Hi Tobias! > Please: t-todo-manager (t-todo-whatever, I don't care) or > $something_a_mainstream_distro_uses, but not yet another bikeshedded > unique name, fun as they are to do. Makes sense. I have attached the patch. Regards, RG. [-- Attachment #1.1.2: 0001-gnu-Rename-t-to-t-todo-manager.patch --] [-- Type: text/x-patch, Size: 1053 bytes --] From 04066b34518fc01290f12093910387e10c04fa08 Mon Sep 17 00:00:00 2001 From: Raghav Gururajan <rg@raghavgururajan.name> Date: Tue, 9 Mar 2021 07:37:28 -0500 Subject: [PATCH] gnu: Rename "t" to "t-todo-manager". * gnu/packages/task-management.scm (t): Rename to t-todo-manager. --- gnu/packages/task-management.scm | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/gnu/packages/task-management.scm b/gnu/packages/task-management.scm index 9667df6030..3edf01a9f5 100644 --- a/gnu/packages/task-management.scm +++ b/gnu/packages/task-management.scm @@ -44,12 +44,12 @@ #:use-module (guix build-system meson) #:use-module (guix build-system python)) -(define-public t +(define-public t-todo-manager ;; Last release is more than 10 years old. Using latest commit. (let ((changeset "89ad444c000b") (revision "97")) (package - (name "t") + (name "t-todo-manager") (version (git-version "1.2.0" revision changeset)) (source (origin -- 2.30.1 [-- Attachment #2: OpenPGP digital signature --] [-- Type: application/pgp-signature, Size: 236 bytes --] ^ permalink raw reply related [flat|nested] 15+ messages in thread
* Re: Opposition to new single-letter package name "t" 2021-03-09 12:40 ` Raghav Gururajan @ 2021-03-09 18:12 ` Nicolas Goaziou 2021-03-10 0:16 ` Mark H Weaver 0 siblings, 1 reply; 15+ messages in thread From: Nicolas Goaziou @ 2021-03-09 18:12 UTC (permalink / raw) To: Raghav Gururajan; +Cc: guix-devel, jgart, LibreMiami Hello, Raghav Gururajan <rg@raghavgururajan.name> writes: > Makes sense. I have attached the patch. Applied. Thank you. Sorry for the mess! Regards, -- Nicolas Goaziou ^ permalink raw reply [flat|nested] 15+ messages in thread
* Re: Opposition to new single-letter package name "t" 2021-03-09 18:12 ` Nicolas Goaziou @ 2021-03-10 0:16 ` Mark H Weaver 0 siblings, 0 replies; 15+ messages in thread From: Mark H Weaver @ 2021-03-10 0:16 UTC (permalink / raw) To: Nicolas Goaziou, Raghav Gururajan; +Cc: guix-devel, jgart, LibreMiami Nicolas Goaziou <mail@nicolasgoaziou.fr> writes: > Raghav Gururajan <rg@raghavgururajan.name> writes: > >> Makes sense. I have attached the patch. > > Applied. Thank you. > > Sorry for the mess! No worries, it's no mess at all. Thanks to Nicolas and Raghav for taking care of renaming it, and also to everyone who contributed to the bike-shed discussion :) Mark ^ permalink raw reply [flat|nested] 15+ messages in thread
* Search improvements (Was: Opposition to new single-letter package name "t") 2021-03-09 11:38 ` Tobias Geerinckx-Rice 2021-03-09 11:40 ` Julien Lepiller 2021-03-09 12:40 ` Raghav Gururajan @ 2021-03-09 13:32 ` Taylan Kammer 2021-03-09 15:12 ` zimoun 2021-03-09 16:18 ` Tobias Geerinckx-Rice 2 siblings, 2 replies; 15+ messages in thread From: Taylan Kammer @ 2021-03-09 13:32 UTC (permalink / raw) To: Tobias Geerinckx-Rice, Raghav Gururajan Cc: guix-devel, jgart, LibreMiami, Nicolas Goaziou On 09.03.2021 12:38, Tobias Geerinckx-Rice wrote: > Raghav Gururajan 写道: >> Since, we already mention "todo list manager" in description, I think >> "ti-cli" is better. > > It says nothing about the package and does not uniquely identify it: > > bundlerApp { > pname = "t"; > [...] > > meta = with lib; { > description = "A command-line power tool for Twitter"; > homepage = "http://sferik.github.io/t/"; > [...] > }; > } > > It's “t”! It's “CLI”! It's... a totally different package[0]! > > Please: t-todo-manager (t-todo-whatever, I don't care) or > $something_a_mainstream_distro_uses, but not yet another bikeshedded > unique name, fun as they are to do. > > Kind regards, > > T G-R > > [0]: > https://github.com/NixOS/nixpkgs/blob/release-20.09/pkgs/tools/misc/t/default.nix > I agree that t-todo-manager is the superior choice. (With a secondary preference for "t-todo-list-manager".) This discussion made me realize that "guix search" might benefit from the following improvement though: I think the relevance score for a search result should be increased significantly if the searched word is a standalone (not substring) part of a package's name when the name is split into dash-separated words. For instance, the package "emacs-hl-todo" should get a much higher score than "emacs-mastodon" when searching for "todo". Currently the Mastodon one has score 11 and the todo one only 9. The same thing goes for the synopsis and description of the package, but with respectively lower increases to the score. (I.e. name > synopsis > description.) Handling of plurals like "todos" instead of "todo" would also be great but could be left to a later step. Any thoughts about / objections to this idea? To be honest I haven't checked if there's maybe already a bug report about this. - Taylan ^ permalink raw reply [flat|nested] 15+ messages in thread
* Re: Search improvements (Was: Opposition to new single-letter package name "t") 2021-03-09 13:32 ` Search improvements (Was: Opposition to new single-letter package name "t") Taylan Kammer @ 2021-03-09 15:12 ` zimoun 2021-03-09 16:18 ` Tobias Geerinckx-Rice 1 sibling, 0 replies; 15+ messages in thread From: zimoun @ 2021-03-09 15:12 UTC (permalink / raw) To: Taylan Kammer Cc: LibreMiami, Raghav Gururajan, jgart, Nicolas Goaziou, Guix Devel Hi, On Tue, 9 Mar 2021 at 14:37, Taylan Kammer <taylan.kammer@gmail.com> wrote: > This discussion made me realize that "guix search" might benefit from > the following improvement though: I think the relevance score for a > search result should be increased significantly if the searched word is > a standalone (not substring) part of a package's name when the name is > split into dash-separated words. Currently, perfect match uses the weight of 5 and substring match uses 1. You are proposing to add something between, say 3, for perfect match on substring delimited by dash. Why not. > For instance, the package "emacs-hl-todo" should get a much higher score > than "emacs-mastodon" when searching for "todo". Currently the Mastodon > one has score 11 and the todo one only 9. Here how the relevance score reads: query: todo | field | emacs-hl-todo | emacs-mastodon | weight | |-------------+----------------+-----------------+--------| | name | 1 | 1 | 4 | | synopsis | 1 | 1 | 3 | | description | 1 | 2 | 2 | |-------------+----------------+-----------------+--------| | total | 1*4+1*3+2*1= 9 | 1*4+1*3+2*2= 11 | | Therefore, something looks wrong here: the score for emacs-hl-todo should be 1*4+1*5*3+1*5*2= 29 because the term TODO should be considered as a perfect match for the query todo. > The same thing goes for the synopsis and description of the package, but > with respectively lower increases to the score. (I.e. name > synopsis > > description.) Your proposal just needs the tweak of 'score' in the function 'relevance' from (guix ui). The weight for the field is another part (see %package-metrics in (guix ui)) > Handling of plurals like "todos" instead of "todo" would also be great > but could be left to a later step. The issue with this is that it is strongly connected to the language. Therefore, an external library implementing Natural Language should be added. And I am not convinced it is worth at the CLI level. > Any thoughts about / objections to this idea? To be honest I haven't > checked if there's maybe already a bug report about this. If you are interested, there is such discussion in this heavy thread: <http://issues.guix.gnu.org/issue/39258> And the 'relevance' function could be improved, for sure. For example, I proposed TF-IDF here: <https://lists.gnu.org/archive/html/guix-devel/2019-07/msg00252.html> and I did some tiny math calculs (optimization) to compute "better" relevance weight (%package-metrics) but the current choice are not so bad and simple enough. :-) Previous week, I have started to examine a strategy based on Bag-Of-Word and some word embedings strategies; mimicking a simple autoencoder [1] such as Word2Vec [2] but since the Guile tools are poor in this field, I have started to use Julia first to look if it is worth to implement or not such solution. My idea is to see how the packages cluster based on the synopsis+description information, then ideally based on this, we should be able to define package similarity and "synonyms". Well, if you are student and you are looking for a cool project about Machine Learning and Data Science, ping me. :-) 1: <https://en.wikipedia.org/wiki/Autoencoder> 2: <https://en.wikipedia.org/wiki/Word2vec> Cheers, simon ^ permalink raw reply [flat|nested] 15+ messages in thread
* Re: Search improvements (Was: Opposition to new single-letter package name "t") 2021-03-09 13:32 ` Search improvements (Was: Opposition to new single-letter package name "t") Taylan Kammer 2021-03-09 15:12 ` zimoun @ 2021-03-09 16:18 ` Tobias Geerinckx-Rice 2021-03-09 18:37 ` zimoun 1 sibling, 1 reply; 15+ messages in thread From: Tobias Geerinckx-Rice @ 2021-03-09 16:18 UTC (permalink / raw) To: Taylan Kammer Cc: Raghav Gururajan, jgart, Mark H Weaver, LibreMiami, Nicolas Goaziou, guix-devel [-- Attachment #1: Type: text/plain, Size: 1168 bytes --] Taylan, Taylan Kammer 写道: > This discussion made me realize that "guix search" might benefit > from > the following improvement though: I think the relevance score > for a > search result should be increased significantly if the searched > word is > a standalone (not substring) part of a package's name when the > name is > split into dash-separated words. Thanks for remembering ‘guix search’! It didn't occur to me at all. For most upstreams whether or not dashes were in vogue[0] when they named their project is literally arbitrary. We'd penalise many other packages like texlive-todonotes, open{ssh,vpn,*}, ktexteditor, r-performanceanalytics, qutebrowser, ... It's not a net win. If I might pet my own peeve, I think clever heuristics appear necessary in part because %package-metrics grossly overscores package names. Rank them *below* synopsis & description--which will contain the name anyway--with a metric of 1, maybe 2. Enough to keep the relevant stuff above the irrelevant stuff (python- > ruby-, etc.) without distorting things as they do now. Kind regards, T G-R [0]: Not a joke. [-- Attachment #2: signature.asc --] [-- Type: application/pgp-signature, Size: 247 bytes --] ^ permalink raw reply [flat|nested] 15+ messages in thread
* Re: Search improvements (Was: Opposition to new single-letter package name "t") 2021-03-09 16:18 ` Tobias Geerinckx-Rice @ 2021-03-09 18:37 ` zimoun 0 siblings, 0 replies; 15+ messages in thread From: zimoun @ 2021-03-09 18:37 UTC (permalink / raw) To: Tobias Geerinckx-Rice Cc: LibreMiami, Raghav Gururajan, jgart, Nicolas Goaziou, Guix Devel Hi Tobias, On Tue, 9 Mar 2021 at 18:14, Tobias Geerinckx-Rice <me@tobias.gr> wrote: > For most upstreams whether or not dashes were in vogue[0] when > they named their project is literally arbitrary. We'd penalise > many other packages like texlive-todonotes, open{ssh,vpn,*}, > ktexteditor, r-performanceanalytics, qutebrowser, ... It's not a > net win. I am not sure to understand what you mean here. > If I might pet my own peeve, I think clever heuristics appear > necessary in part because %package-metrics grossly overscores > package names. Rank them *below* synopsis & description--which > will contain the name anyway--with a metric of 1, maybe 2. Enough > to keep the relevant stuff above the irrelevant stuff (python- > > ruby-, etc.) without distorting things as they do now. I really did math, i.e., write the scoring function, something like (to simplify) score(package, query) = sum_{term in query} (wS cS + wD cD + w) where wS, wD, wN are the weights for synopsis, description, name and cS, cD, cN are the number of occurrences. Then for example computed Jacobian and so on in order to see the relation between the weights w* and the number of occurrence c*. Or I gave a look at the condition to have: score(package_1, query) = score(package_2, query) and basically, using the linear relevance as it is currently, the weight (%package-metrics) are not so bad; you cannot find a really better heuristic. Another conclusion is: it really depends on the number of terms the query has. Basically, if you type one term, you know what you are looking for and it is the package name but your are not sure. For more terms, currently the result strongly depends on the quality of the synopsis and description. For instance, try: guix search gnu compiler and compare the description of all the packages with a relevance higher than 4 (gcc-toolchain). Well, with a linear and local scoring function as it is currently, you cannot improve much, IMHO. By local, I mean only considering the words of one package independently of the words of other packages. That's why TF-IDF [1]. For a concrete example, see <https://lists.gnu.org/archive/html/guix-devel/2019-07/msg00252.html>. Once you have a TF-IDF, the natural scoring is BM25 [2]. Well, it is included in Xapian and there is a patch by Arun using Xapian as a backend for "guix search", see <http://issues.guix.gnu.org/issue/39258#14>. It is missing a good evaluation, i.e., queries examples. I have asked such examples (what query an user type and what they are expecting) here <https://lists.gnu.org/archive/html/guix-devel/2020-05/msg00190.html> but no one replied and since I am enough comfortable with searching with Guix and other bugs are more annoying for my workflow, I moved to other stuff. For another discussion on the topic, see <https://lists.gnu.org/archive/html/guix-devel/2020-01/msg00222.html>. Since 2020, I have read pieces of "word embdeding" (part of vogue[0] graph neural nets), and I think it would a great project: first some vogue[0] stats to evaluate how the packages cluster together, i.e., is emacs-foo closer to emacs-bar or python-foo? and second depending on the results, implement such embdeding to improve "guix search". The first means use Julia (or package PyTorch for Guix ;-)) and the second means implement targeting Guile (it could awesome to have an equivalent to Zygote [3,4] for Guile). 0: Not a joke. :-) 1: <https://en.wikipedia.org/wiki/Tf%E2%80%93idf> 2: <https://en.wikipedia.org/wiki/Okapi_BM25> 3: <https://github.com/FluxML/Zygote.jl> 4: <https://arxiv.org/pdf/1810.07951.pdf> Cheers, simon ^ permalink raw reply [flat|nested] 15+ messages in thread
end of thread, other threads:[~2021-03-10 0:18 UTC | newest] Thread overview: 15+ messages (download: mbox.gz follow: Atom feed -- links below jump to the message on this page -- 2021-03-09 5:27 Opposition to new single-letter package name "t" Mark H Weaver 2021-03-09 5:39 ` Raghav Gururajan 2021-03-09 5:47 ` jgart 2021-03-09 6:08 ` Raghav Gururajan 2021-03-09 9:35 ` Leo Prikler 2021-03-09 11:38 ` Tobias Geerinckx-Rice 2021-03-09 11:40 ` Julien Lepiller 2021-03-09 13:09 ` Ricardo Wurmus 2021-03-09 12:40 ` Raghav Gururajan 2021-03-09 18:12 ` Nicolas Goaziou 2021-03-10 0:16 ` Mark H Weaver 2021-03-09 13:32 ` Search improvements (Was: Opposition to new single-letter package name "t") Taylan Kammer 2021-03-09 15:12 ` zimoun 2021-03-09 16:18 ` Tobias Geerinckx-Rice 2021-03-09 18:37 ` zimoun
Code repositories for project(s) associated with this public inbox https://git.savannah.gnu.org/cgit/guix.git This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).