[DISCUSSION] Add "Recent News" to orgmode.org

[DISCUSSION] Add "Recent News" to orgmode.org

[Ihor Radchenko]

Hi,

What do you think about an idea to modify Org mode front page
(https://orgmode.org/), adding the most recent blog posts and
discussions about Org mode?

We might use Org-related records from Sacha's news and/or
https://planet.emacslife.com/ as a source, scrape it regularly (once per
day/week or on every export), and embed the relevant links into the
orgweb/index.html

This way, visitors can easily see how active Org mode community is and
discover Org-related blogs/forums.

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>

Re: [DISCUSSION] Add "Recent News" to orgmode.org

[Thomas Dye]

+1

Tom

> On Feb 4, 2024, at 9:40 AM, Ihor Radchenko <yantar92@posteo.net> wrote:
> 
> Hi,
> 
> What do you think about an idea to modify Org mode front page
> (https://orgmode.org/), adding the most recent blog posts and
> discussions about Org mode?
> 
> We might use Org-related records from Sacha's news and/or
> https://planet.emacslife.com/ as a source, scrape it regularly (once per
> day/week or on every export), and embed the relevant links into the
> orgweb/index.html
> 
> This way, visitors can easily see how active Org mode community is and
> discover Org-related blogs/forums.
> 
> --
> Ihor Radchenko // yantar92,
> Org mode contributor,
> Learn more about Org mode at <https://orgmode.org/>.
> Support Org development at <https://liberapay.com/org-mode>,
> or support my work at <https://liberapay.com/yantar92>
> 

Re: [DISCUSSION] Add "Recent News" to orgmode.org

[Juan Manuel Macías]

Ihor Radchenko writes:

> Hi,
>
> What do you think about an idea to modify Org mode front page
> (https://orgmode.org/), adding the most recent blog posts and
> discussions about Org mode?
>
> We might use Org-related records from Sacha's news and/or
> https://planet.emacslife.com/ as a source, scrape it regularly (once per
> day/week or on every export), and embed the relevant links into the
> orgweb/index.html
>
> This way, visitors can easily see how active Org mode community is and
> discover Org-related blogs/forums.

+1

Best regards,

Juan Manuel 

Re: [DISCUSSION] Add "Recent News" to orgmode.org

[Juergen Fenn]

Am 04.02.24 um 20:41 Uhr schrieb Ihor Radchenko:
> What do you think about an idea to modify Org mode front page
> (https://orgmode.org/), adding the most recent blog posts and
> discussions about Org mode?

I think that would be a good idea. Please go ahead.

Regards,
Jürgen.

Re: [DISCUSSION] Add "Recent News" to orgmode.org

[Sacha Chua]

[-- Attachment #1: Type: text/plain, Size: 611 bytes --]

On Sun, Feb 4, 2024, 14:37 Ihor Radchenko <yantar92@posteo.net> wrote:

>
> What do you think about an idea to modify Org mode front page
> (https://orgmode.org/), adding the most recent blog posts and

discussions about Org mode?

We might use Org-related records from Sacha's news and/or
> https://planet.emacslife.com/ as a source, scrape it regularly (once per
> day/week or on every export), and embed the relevant links into the
> orgweb/index.html
>

If you like, the Org Mode section can be parsed out of
https://github.com/sachac/emacs-news/blob/master/most-recent.org and
included wherever. :)

Sacha

[-- Attachment #2: Type: text/html, Size: 1519 bytes --]

Re: [DISCUSSION] Add "Recent News" to orgmode.org

[Jean Louis]

* Ihor Radchenko <yantar92@posteo.net> [2024-02-04 22:40]:
> What do you think about an idea to modify Org mode front page
> (https://orgmode.org/), adding the most recent blog posts and
> discussions about Org mode?
> 
> We might use Org-related records from Sacha's news and/or
> https://planet.emacslife.com/ as a source, scrape it regularly (once per
> day/week or on every export), and embed the relevant links into the
> orgweb/index.html
> 
> This way, visitors can easily see how active Org mode community is and
> discover Org-related blogs/forums.

Very good idea!


-- 
Jean

Take action in Free Software Foundation campaigns:
https://www.fsf.org/campaigns

In support of Richard M. Stallman
https://stallmansupport.org/

Re: [DISCUSSION] Add "Recent News" to orgmode.org

[Bastien Guerry]

I'm all for any experiment that will help interesting Org post get
more traction.

If someone wants to play with https://git.sr.ht/~bzg/orgweb so that 
it includes latest Org posts from Sacha's URL, please go ahead!

A complementary suggestion: let's activate the "Blog" tab on Woof (at
https://tracker.orgmode.org) so that when people send an email to the
list prefixed with [BLOG], it is referenced on this tab. Then, a RSS
feed is available from https://tracker.orgmode.org/blog.rss that we
can parse on orgmode.org.

Let me know if activating the detection of BLOG posts on the mailing
list sounds useful.

-- 
 Bastien Guerry

Re: [DISCUSSION] Add "Recent News" to orgmode.org

[Ihor Radchenko]

Bastien Guerry <bzg@gnu.org> writes:

> A complementary suggestion: let's activate the "Blog" tab on Woof (at
> https://tracker.orgmode.org) so that when people send an email to the
> list prefixed with [BLOG], it is referenced on this tab. Then, a RSS
> feed is available from https://tracker.orgmode.org/blog.rss that we
> can parse on orgmode.org.
>
> Let me know if activating the detection of BLOG posts on the mailing
> list sounds useful.

That does sound useful.
And we may trivially add the recent BLOG posts using something like
#+INCLUDE: "https://tracker.orgmode.org/index.org" :lines 1-10

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>

Re: [DISCUSSION] Add "Recent News" to orgmode.org

[Bastien Guerry]

Ihor Radchenko <yantar92@posteo.net> writes:

> And we may trivially add the recent BLOG posts using something like
>
> #+INCLUDE: "https://tracker.orgmode.org/index.org" :lines 1-10

Yes, but the non-trivial thing is to schedule the CI regularily so
that index.html is updating regularily.  I believe integrating a RSS
feed with some free JS code could work.  Patch welcome!

-- 
 Bastien Guerry

Re: [DISCUSSION] Add "Recent News" to orgmode.org

[Ihor Radchenko]

Bastien Guerry <bzg@gnu.org> writes:

> Ihor Radchenko <yantar92@posteo.net> writes:
>
>> And we may trivially add the recent BLOG posts using something like
>>
>> #+INCLUDE: "https://tracker.orgmode.org/index.org" :lines 1-10
>
> Yes, but the non-trivial thing is to schedule the CI regularily so
> that index.html is updating regularily.  I believe integrating a RSS
> feed with some free JS code could work.  Patch welcome!

Wouldn't a cron job work? Similar to how we schedule CI for Org mode tests.

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>

Re: [DISCUSSION] Add "Recent News" to orgmode.org

[Bastien Guerry]

Ihor Radchenko <yantar92@posteo.net> writes:

> Wouldn't a cron job work? Similar to how we schedule CI for Org mode
> tests.

Yes, you're right!

-- 
 Bastien Guerry

Re: [DISCUSSION] Add "Recent News" to orgmode.org

[Bastien Guerry]

Ihor Radchenko <yantar92@posteo.net> writes:

> Wouldn't a cron job work? Similar to how we schedule CI for Org mode
> tests.

I've set this cron job to run every six hours and limited the number
of entries to 5 to not clutter the homepage.

-- 
 Bastien Guerry

Re: [DISCUSSION] Add "Recent News" to orgmode.org

[Ihor Radchenko]

Bastien Guerry <bzg@gnu.org> writes:

> Ihor Radchenko <yantar92@posteo.net> writes:
>
>> Wouldn't a cron job work? Similar to how we schedule CI for Org mode
>> tests.
>
> I've set this cron job to run every six hours and limited the number
> of entries to 5 to not clutter the homepage.

Note that
https://git.sr.ht/~bzg/orgweb/commit/c9531ba7ad7647d7322c06e8dd8ee3fabbb992a8
has stray unresolved conflict markers:

+<<<<<<< HEAD

Also, it looks like https://tracker.orgmode.org/index.org does not sort
links by date. It would be nice if top 5 links were also the most recent.

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>

Re: [DISCUSSION] Add "Recent News" to orgmode.org

[Bastien Guerry]

Ihor Radchenko <yantar92@posteo.net> writes:

> Bastien Guerry <bzg@gnu.org> writes:
>
>> Ihor Radchenko <yantar92@posteo.net> writes:
>>
>>> Wouldn't a cron job work? Similar to how we schedule CI for Org mode
>>> tests.
>>
>> I've set this cron job to run every six hours and limited the number
>> of entries to 5 to not clutter the homepage.
>
> Note that
> https://git.sr.ht/~bzg/orgweb/commit/c9531ba7ad7647d7322c06e8dd8ee3fabbb992a8
> has stray unresolved conflict markers:
>
> +<<<<<<< HEAD

Oups, fixed.

> Also, it looks like https://tracker.orgmode.org/index.org does not sort
> links by date. It would be nice if top 5 links were also the most recent.

Yes, indeed. I'll see when I can hack on this. Help from Clojure
hackers is welcome here: https://git.sr.ht/~bzg/woof

-- 
 Bastien Guerry

Re: [DISCUSSION] Add "Recent News" to orgmode.org

[Ihor Radchenko]

[-- Attachment #1: Type: text/plain, Size: 351 bytes --]

Bastien Guerry <bzg@gnu.org> writes:

>> Also, it looks like https://tracker.orgmode.org/index.org does not sort
>> links by date. It would be nice if top 5 links were also the most recent.
>
> Yes, indeed. I'll see when I can hack on this. Help from Clojure
> hackers is welcome here: https://git.sr.ht/~bzg/woof

Something like the attached maybe.


[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #2: 0001-src-bzg-data.clj-get-data-Sort-list-of-entries-by-da.patch --]
[-- Type: text/x-patch, Size: 1050 bytes --]

From 2e170f073ae258d27680baf16f8db1aa2dcf9b78 Mon Sep 17 00:00:00 2001
Message-ID: <2e170f073ae258d27680baf16f8db1aa2dcf9b78.1709893748.git.yantar92@posteo.net>
From: Ihor Radchenko <yantar92@posteo.net>
Date: Fri, 8 Mar 2024 13:28:12 +0300
Subject: [PATCH] src/bzg/data.clj (get-data): Sort list of entries by date
 (latest first)

Link: https://orgmode.org/list/87wmqdxmds.fsf@bzg.fr
---
 src/bzg/data.clj | 2 ++
 1 file changed, 2 insertions(+)

diff --git a/src/bzg/data.clj b/src/bzg/data.clj
index 99ab66d..333dd6a 100644
--- a/src/bzg/data.clj
+++ b/src/bzg/data.clj
@@ -74,6 +74,8 @@
                     :requests (fetch/requests source-id search)
                     :patches  (fetch/patches source-id search)
                     :news     (fetch/news source-id search))
+        ;; Display the latest first.
+        resources (reverse (sort resources))
         headers   (condp = format
                     "rss"  {"Content-Type" "application/xml"}
                     "md"   {"Content-Type" "text/plain; charset=utf-8"}
-- 
2.43.0


[-- Attachment #3: Type: text/plain, Size: 224 bytes --]


-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>

Re: [DISCUSSION] Add "Recent News" to orgmode.org

[Ihor Radchenko]

Ihor Radchenko <yantar92@posteo.net> writes:

> +        ;; Display the latest first.
> +        resources (reverse (sort resources))

* (sort-by :date resources)

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>

Re: [DISCUSSION] Add "Recent News" to orgmode.org

[Bastien Guerry]

Ihor Radchenko <yantar92@posteo.net> writes:

> Something like the attached maybe.

Thanks! Applied: https://git.sr.ht/~bzg/woof/commit/177ea5b1

-- 
 Bastien Guerry

Re: [DISCUSSION] Add "Recent News" to orgmode.org

[Ihor Radchenko]

Bastien Guerry <bzg@gnu.org> writes:

> A complementary suggestion: let's activate the "Blog" tab on Woof (at
> https://tracker.orgmode.org) so that when people send an email to the
> list prefixed with [BLOG], it is referenced on this tab. Then, a RSS
> feed is available from https://tracker.orgmode.org/blog.rss that we
> can parse on orgmode.org.

After
https://git.sr.ht/~bzg/orgweb/commit/d7b6524cf62a947db64d29c5bf879499ab8951d7,
not only blogs are included in the front page of orgmode.org, but also
bug reports and everything else.

I do not see much problem listing announcements, blogs, and requests
there; but bug reports are probably not something we want to show to
newbies right at the front page.

Also, what do you think about the following ideas:

1. Adding a header before the recent news list. Maybe something like
   "Project heartbeat".

2. Moving recent news after features/install/quickstart/contribute
   buttons.

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>

Re: [DISCUSSION] Add "Recent News" to orgmode.org

[Bastien Guerry]

Ihor Radchenko <yantar92@posteo.net> writes:

> After
> https://git.sr.ht/~bzg/orgweb/commit/d7b6524cf62a947db64d29c5bf879499ab8951d7,
> not only blogs are included in the front page of orgmode.org, but also
> bug reports and everything else.

Yes, https://tracker.orgmode.org/index.org includes everything.

> I do not see much problem listing announcements, blogs, and requests
> there; but bug reports are probably not something we want to show to
> newbies right at the front page.

I restricted it to "news": https://tracker.orgmode.org/news.org

> Also, what do you think about the following ideas:
>
> 1. Adding a header before the recent news list. Maybe something like
>    "Project heartbeat".
>
> 2. Moving recent news after features/install/quickstart/contribute
>    buttons.

Yes, please go as you see fit.

-- 
 Bastien Guerry

Re: [DISCUSSION] Add "Recent News" to orgmode.org

[Ihor Radchenko]

Bastien Guerry <bzg@gnu.org> writes:

>> Also, what do you think about the following ideas:
>>
>> 1. Adding a header before the recent news list. Maybe something like
>>    "Project heartbeat".
>>
>> 2. Moving recent news after features/install/quickstart/contribute
>>    buttons.
>
> Yes, please go as you see fit.

It looks like there is some problem with publishing index.org in
particular. I made several changes, but none of them is visible on
orgmode.org. At the same time, my changes to tools.org page are visible.

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>

Re: [DISCUSSION] Add "Recent News" to orgmode.org

[Bastien Guerry]

Ihor Radchenko <yantar92@posteo.net> writes:

> It looks like there is some problem with publishing index.org in
> particular. I made several changes, but none of them is visible on
> orgmode.org. At the same time, my changes to tools.org page are
> visible.

Yes -- perhaps this error has something to do with this:
https://builds.sr.ht/~bzg/job/1176324#task-build-41

-- 
 Bastien Guerry

Re: [DISCUSSION] Add "Recent News" to orgmode.org

[Ihor Radchenko]

Bastien Guerry <bzg@gnu.org> writes:

> Ihor Radchenko <yantar92@posteo.net> writes:
>
>> It looks like there is some problem with publishing index.org in
>> particular. I made several changes, but none of them is visible on
>> orgmode.org. At the same time, my changes to tools.org page are
>> visible.
>
> Yes -- perhaps this error has something to do with this:
> https://builds.sr.ht/~bzg/job/1176324#task-build-41

I tried to add news.org to safe remote resources in
https://git.sr.ht/~bzg/orgweb/commit/0b2d6c49efce02b0ae6736f0d8863fc5c2ebeb9f

However, the page is still not updated.
And there is no trace of build failure in
https://lists.sr.ht/~bzg/org-build-failures (understandably, because the
errors are suppressed in publish.sh)

Maybe we should add an equivalent of `worg-publish-stop-on-error' to
orgweb publish process?

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>

Re: [DISCUSSION] Add "Recent News" to orgmode.org

[Bastien Guerry]

Ihor Radchenko <yantar92@posteo.net> writes:

> Maybe we should add an equivalent of `worg-publish-stop-on-error' to
> orgweb publish process?

Good idea, done.  Let's see if it helps!

-- 
 Bastien Guerry

Re: [DISCUSSION] Add "Recent News" to orgmode.org

[Ihor Radchenko]

Bastien Guerry <bzg@gnu.org> writes:

>> I do not see much problem listing announcements, blogs, and requests
>> there; but bug reports are probably not something we want to show to
>> newbies right at the front page.
>
> I restricted it to "news": https://tracker.orgmode.org/news.org

Looks like we do not have much news, and the page appears like not much
is going on.

I just tried to add requests and Sacha's news list in
https://git.sr.ht/~bzg/orgweb/commit/caa43468ad52694c51b1b33f02327e88b07ed81d

However, the page did not get updated. May you please check the build
logs? Is there anything fishy going on there?

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>

Re: [DISCUSSION] Add "Recent News" to orgmode.org

[Bastien Guerry]

Hi Ihor,

Ihor Radchenko <yantar92@posteo.net> writes:

> However, the page did not get updated. May you please check the build
> logs? Is there anything fishy going on there?

https://builds.sr.ht/~bzg/job/1246209 still says:

  "The remote resource "https://tracker.orgmode.org/news.org" is
  considered unsafe, and will not be downloaded."

I've committed this:

  https://git.sr.ht/~bzg/orgweb/commit/f494af7c2f

Perhaps there is a buggy combinaison of `org-resource-download-policy'
and `org-safe-remote-resources' in general, in which case this needs
to get fixed -- I didn't test further.  If this does not work, I will
have another look this afternoon.

Thanks!
  
-- 
 Bastien Guerry

Re: [DISCUSSION] Add "Recent News" to orgmode.org

[Ihor Radchenko]

[-- Attachment #1: Type: text/plain, Size: 1067 bytes --]

Bastien Guerry <bzg@gnu.org> writes:

>> However, the page did not get updated. May you please check the build
>> logs? Is there anything fishy going on there?
>
> https://builds.sr.ht/~bzg/job/1246209 still says:
>
>   "The remote resource "https://tracker.orgmode.org/news.org" is
>   considered unsafe, and will not be downloaded."
>
> I've committed this:
>
>   https://git.sr.ht/~bzg/orgweb/commit/f494af7c2f
>
> Perhaps there is a buggy combinaison of `org-resource-download-policy'
> and `org-safe-remote-resources' in general, in which case this needs
> to get fixed -- I didn't test further.  If this does not work, I will
> have another look this afternoon.

I think that the old regexp was simply not accurate. In particular, the
trailing \' prohibited all the Urls other than literally
https://tracker.orgmode.org.

That said, it is annoying that Org mode did not provide a clear
indication that something is fishy other than a simple message.

Attaching tentative patch that makes Org mode throw an error when a
prompt is requested for an external URI.


[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #2: 0001-org-confirm-resource-safe-Throw-an-error-when-non-in.patch --]
[-- Type: text/x-patch, Size: 2171 bytes --]

From 008c76edc6f79cac3c987ec9ba84674bc89a4f85 Mon Sep 17 00:00:00 2001
Message-ID: <008c76edc6f79cac3c987ec9ba84674bc89a4f85.1717932899.git.yantar92@posteo.net>
From: Ihor Radchenko <yantar92@posteo.net>
Date: Sun, 9 Jun 2024 13:27:46 +0200
Subject: [PATCH] org--confirm-resource-safe: Throw an error when
 non-interactive

* lisp/org.el (org--confirm-resource-safe): When asking about resource
safety in non-interactive mode throw an error rather than silently not
downloading the resource.  The previous behavior may remote
 #+include's seemingly being ignored.
* etc/ORG-NEWS (Org mode may throw an error when attempting to include
remote unsafe resource): Announce the change.
---
 etc/ORG-NEWS | 8 ++++++++
 lisp/org.el  | 3 ++-
 2 files changed, 10 insertions(+), 1 deletion(-)

diff --git a/etc/ORG-NEWS b/etc/ORG-NEWS
index 6265a17fb..5af437497 100644
--- a/etc/ORG-NEWS
+++ b/etc/ORG-NEWS
@@ -18,6 +18,14 @@ Please send Org bug reports to mailto:emacs-orgmode@gnu.org.
 # require user action for most Org mode users.
 # Sorted from most important to least important.
 
+*** Org mode may throw an error when attempting to include remote unsafe resource
+
+Previously, when ~org-resource-download-policy~ is ~ask~ (default),
+and Emacs is running in batch mode, Org mode simply skipped unsafe
+remote resources in the =#+include:='s.  Now, an error is thrown to
+avoid seemingly ignored =#+include= statements when publishing via
+batch scripts.
+
 ** New features
 
 # We list the most important features, and the features that may
diff --git a/lisp/org.el b/lisp/org.el
index cf4c9a99e..0f3818504 100644
--- a/lisp/org.el
+++ b/lisp/org.el
@@ -4741,7 +4741,8 @@ (defun org--safe-remote-resource-p (uri)
 
 (defun org--confirm-resource-safe (uri)
   "Ask the user if URI should be considered safe, returning non-nil if so."
-  (unless noninteractive
+  (if noninteractive
+      (error "Cannot prompt about %S interactively in batch mode.  Aborting" uri)
     (let ((current-file (and (buffer-file-name (buffer-base-buffer))
                              (file-truename (buffer-file-name (buffer-base-buffer)))))
           (domain (and (string-match
-- 
2.45.1


[-- Attachment #3: Type: text/plain, Size: 225 bytes --]



-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>

Re: [DISCUSSION] Add "Recent News" to orgmode.org

[Bastien Guerry]

Ihor Radchenko <yantar92@posteo.net> writes:

> Attaching tentative patch that makes Org mode throw an error when a
> prompt is requested for an external URI.

LGTM!  Thanks.

-- 
 Bastien Guerry

Re: [DISCUSSION] Add "Recent News" to orgmode.org

[Ihor Radchenko]

Bastien Guerry <bzg@gnu.org> writes:

> Ihor Radchenko <yantar92@posteo.net> writes:
>
>> Attaching tentative patch that makes Org mode throw an error when a
>> prompt is requested for an external URI.
>
> LGTM!  Thanks.

Applied, onto main.
https://git.savannah.gnu.org/cgit/emacs/org-mode.git/commit/?id=ea4a690c1

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>