Re: Org tag generator?

[Jean Louis <bugs@gnu.support>]

* Christopher Howard <christopher@librehacker.com> [2024-12-24 19:35]:
> Now you are recommending a system whereby I myself have to manual
> recognize and record all specific words that lead me to assign a
> specific tag. This works, in a sense, but does nothing to reduce my
> work load. There might be, for example, thousands of plant-related
> words that lead me to apply the tag :botany:. I don't want to have
> to figure out what those words are specifically and make a record of
> them. I just want to intuitively apply the tag :botany: and then the
> software figures out, after observing many nodes, that the words
> "rainforest" or "flower" or should generate the tag :botany:.

I have found deterministic way of getting keywords by using some
manual preparation.

I am using PostgreSQL database, and I am aware that this may sound
hard, though is not.

Full documents could easily be imported into PostgreSQL, and then
tsvector for full text search generated.

I have done that.

I have table hyobjects, with hyobjects_tokens, containing tsvector
type for English (or other language).

Let us say I need some 2 words terms from database, by their ranking,
then it is breeze:

SELECT 'Ugandan ' || sub_words[1] AS term, COUNT(*) AS count
FROM hyobjects
CROSS JOIN LATERAL regexp_matches(hyobjects_text, '\mUgandan\s+([a-zA-Z]+)', 'g') AS sub_words
WHERE NOT EXISTS (
    SELECT 1 
    FROM stopwords 
    WHERE LOWER(stopwords_name) = LOWER(sub_words[1])
)
GROUP BY sub_words[1]
ORDER BY count DESC;

         term         | count 
----------------------+-------
 Ugandan company      |    82
 Ugandan shillings    |    58
 Ugandan coffee       |    26
 Ugandan miners       |    12
 Ugandan people       |    12
 Ugandan shilling     |     8
 Ugandan Coffee       |     8
 Ugandan gold         |     7
 Ugandan Constitution |     6
 Ugandan government   |     6

I like this very deterministic way, so I will use it for automatic
referencing and tagging for easier sales and marketing purposes.

If you happen to need help to generate keywords this way, I am 😄
available.

-- 
Jean Louis