Bug: org-anniversary dates not exported to iCalendar [9.4.6 (9.4.6-3-g37f69b-elpaplus @ /home/marcus/.emacs.d/elpa/org-plus-contrib-20210531/)]

Bug: org-anniversary dates not exported to iCalendar [9.4.6 (9.4.6-3-g37f69b-elpaplus @ /home/marcus/.emacs.d/elpa/org-plus-contrib-20210531/)]

[Marcus Zibrowius]

[-- Attachment #1: Type: text/plain, Size: 12465 bytes --]


I have an org-file with entries of the form

* Abel's birthday party
  <2023-11-13>

and with entries of the form

* Abel Jacobi
%%(org-anniversary 1978 11 11) Abel %d

Both types of events show up in my agenda view in emacs. However, when I
export to ics (e.g. org-export-dispatch > [c] Export to icalendar > [f]
Current file), only the former type of entries is included in the
resulting ics-file.

User "phils" on the (emacs) StackExchange website suspected this is a bug and
directed me here.  Following their advice, I tried using diary-anniversary
instead of org-anniversary.  With this change, the event does get exported
correctly to icalendar, but it no longer shows up in my agenda view in
emacs. (Also, %d gets exported verbatim rather than converted to the
appopriate integer.)

https://emacs.stackexchange.com/q/78003/13054

==============


Emacs  : GNU Emacs 28.2 (build 2, x86_64-pc-linux-gnu, GTK+ Version 3.24.20, cairo version 1.16.0)
 of 2023-06-02
Package: Org mode version 9.4.6 (9.4.6-3-g37f69b-elpaplus @ /home/marcus/.emacs.d/elpa/org-plus-contrib-20210531/)

current state:
==============
(setq
 org-agenda-prefix-format '((agenda . " %i %-12:c%?-12t% s %b")
                            (todo . " %i %-12:c") (tags . " %i %-12:c")
                            (search . " %i %-12:c"))
 org-link-elisp-confirm-function 'yes-or-no-p
 org-agenda-skip-deadline-prewarning-if-scheduled 'pre-scheduled
 org-after-todo-state-change-hook '(org-checklist)
 org-bibtex-headline-format-function #[257 "\300\236A\207" [:title] 3 "\n\n(fn ENTRY)"]
 org-log-done 'time
 org-agenda-tags-todo-honor-ignore-options t
 org-agenda-custom-commands '(("p" tags "PROJECT/-DONE" nil)
                              ("r" "Routine"
                               ((agenda "" ((org-agenda-span 'week)))
                                (tags "PROJECT/-DONE") (tags "ROUTINE"))
                               )
                              (" " "Overwiew"
                               ((agenda ""
                                 ((org-agenda-ndays 1)
                                  (org-agenda-tag-filter-preset '("-routine")))
                                 )
                                )
                               )
                              )
 org-log-into-drawer t
 org-agenda-skip-scheduled-if-done t
 org-agenda-files '([NAMES REDACTED])
  org-refile-targets '((nil :maxlevel . 2) (org-agenda-files :maxlevel . 2))
 org-export-before-parsing-hook '(org-attach-expand-links)
 org-default-notes-file "~/uniNotes/refile.org"
 org-finalize-agenda-hook '((lambda nil
                             (save-excursion
                              (color-org-header "DAY:" "red" "white")
                              (color-org-header "Home:" "azure" "black")
                              (color-org-header "People:" "azure" "black")
                              (color-org-header "Uni:" "white" "red")
                              (color-org-header "UniS:" "white" "deep pink")
                              (color-org-header "Conf:" "misty rose" "black"))
                             )
                            )
 org-archive-hook '(org-attach-archive-delete-maybe)
 org-odt-format-inlinetask-function 'org-odt-format-inlinetask-default-function
 org-ascii-format-drawer-function #[771 "\207" [] 4 "\n\n(fn NAME CONTENTS WIDTH)"]
 org-cycle-hook '(org-cycle-hide-archived-subtrees org-cycle-hide-drawers
                  org-cycle-show-empty-lines
                  org-optimize-window-after-visibility-change)
 org-export-with-broken-links 'mark
 org-mode-hook '(my-adaptive-wrap-prefix-disable
                 #[0 "\300\301\302\303\304$\207"
                   [add-hook change-major-mode-hook org-show-all append local] 5]
                 #[0 "\300\301\302\303\304$\207"
                   [add-hook change-major-mode-hook org-babel-show-result-all
                    append local]
                   5]
                 org-babel-result-hide-spec org-babel-hide-all-hashes
                 org-eldoc-load)
 org-agenda-skip-deadline-if-done t
 org-mairix-gnus-select-display-group-function 'org-mairix-gnus-select-display-group-function-gg
 org-agenda-time-grid '((daily today remove-match)
                        (800 1000 1200 1400 1600 1800 2000) "......"
                        "----------------")
 org-latex-format-drawer-function #[514 "\207" [] 3 "\n\n(fn _ CONTENTS)"]
 org-priority-faces '((65 :foreground "red" :weight bold) (66 :foreground "red")
                      (67 :foreground "gray"))
 org-icalendar-use-scheduled '(event-if-not-todo)
 org-latex-format-headline-function 'org-latex-format-headline-default-function
 org-confirm-shell-link-function 'yes-or-no-p
 org-reveal-start-hook '(org-decrypt-entry)
 org-html-format-drawer-function #[514 "\207" [] 3 "\n\n(fn NAME CONTENTS)"]
 outline-isearch-open-invisible-function 'outline-isearch-open-invisible
 org-checklist-export-function 'org-export-as-ascii
 org-stuck-projects '("TODO={.+}/-DONE-IGNORE-CANCELLED" nil nil
                      "SCHEDULED:\\|DEADLINE:")
 org-agenda-hide-tags-regexp "ROUTINE\\|COMMUNITY\\|RESEARCH\\|TEACH\\|ADMIN"
 org-startup-indented t
 org-odt-format-headline-function 'org-odt-format-headline-default-function
 org-agenda-mode-hook '(dfeich/org-agenda-mode-fn)
 org-agenda-before-write-hook '(org-agenda-add-entry-text)
 org-src-mode-hook '(org-src-babel-configure-edit-buffer
                     org-src-mode-configure-edit-buffer)
 org-confirm-elisp-link-function 'yes-or-no-p
 org-tags-exclude-from-inheritance '("PROJECT")
 org-todo-state-tags-triggers '(("CANCELLED" ("CANCELLED" . t))
                                ("WAITING" ("WAITING" . t))
                                ("HOLD" ("WAITING") ("HOLD" . t))
                                (done ("WAITING") ("HOLD"))
                                ("TODO" ("WAITING") ("CANCELLED") ("HOLD"))
                                ("NEXT" ("WAITING") ("CANCELLED") ("HOLD"))
                                ("DONE" ("WAITING") ("CANCELLED") ("HOLD")))
 org-clock-out-remove-zero-time-clocks t
 org-icalendar-include-body nil
 org-todo-keywords '((sequence "TODO(t)" "NEXT(n)" "|" "DONE(d)")
                     (sequence "IDEA" "WAITING(w@/!)" "HOLD(h@/!)" "|" "IGNORE"
                      "CANCELLED(c@/!)")
                     )
 org-clock-out-hook '(org-clock-remove-empty-clock-drawer)
 org-speed-command-hook '(org-speed-command-activate
                          org-babel-speed-command-activate)
 org-html-format-inlinetask-function 'org-html-format-inlinetask-default-function
 org-ascii-format-inlinetask-function 'org-ascii-format-inlinetask-default
 org-icalendar-use-deadline '(event-if-not-todo)
 org-odt-format-drawer-function #[514 "\207" [] 3 "\n\n(fn NAME CONTENTS)"]
 org-export-backends '(ascii html icalendar latex md odt)
 org-icalendar-alarm-time 60
 org-clock-persist t
 org-latex-format-inlinetask-function 'org-latex-format-inlinetask-default-function
 org-tab-first-hook '(org-babel-hide-result-toggle-maybe
                      org-babel-header-arg-expand)
 org-link-shell-confirm-function 'yes-or-no-p
 org-babel-pre-tangle-hook '(save-buffer)
 org-clock-display-default-range 'untilnow
 org-agenda-loop-over-headlines-in-active-region nil
 org-agenda-start-on-weekday nil
 org-todo-keyword-faces '(("TODO" :foreground "red" :weight bold)
                          ("NEXT" :foreground "blue" :weight bold)
                          ("DONE" :foreground "forest green" :weight bold)
                          ("IDEA" :foreground "magenta" :weight bold)
                          ("WAITING" :foreground "orange" :weight bold)
                          ("HOLD" :foreground "magenta" :weight bold)
                          ("CANCELLED" :foreground "forest green" :weight bold))
 org-mairix-display-hook 'org-mairix-gnus-display-results
 org-occur-hook '(org-first-headline-recenter)
 org-metadown-hook '(org-babel-pop-to-session-maybe)
 org-treat-S-cursor-todo-selection-as-state-change nil
 org-link-parameters '(("attachment" :follow org-attach-follow :complete
                        org-attach-complete-link)
                       ("id" :follow org-id-open)
                       ("message" :follow org-mac-message-open)
                       ("x-devonthink-item" :follow org-devonthink-item-open)
                       ("mac-evernote" :follow org-mac-evernote-note-open)
                       ("mac-outlook" :follow org-mac-outlook-message-open)
                       ("acrobat" :follow org-mac-acrobat-open)
                       ("skim" :follow org-mac-skim-open)
                       ("addressbook" :follow org-mac-addressbook-item-open)
                       ("x-together-item" :follow org-mac-together-item-open)
                       ("mairix" :follow org-mairix-open :store
                        org-mairix-store-gnus-link)
                       ("eww" :follow org-eww-open :store org-eww-store-link)
                       ("rmail" :follow org-rmail-open :store
                        org-rmail-store-link)
                       ("mhe" :follow org-mhe-open :store org-mhe-store-link)
                       ("irc" :follow org-irc-visit :store org-irc-store-link
                        :export org-irc-export)
                       ("info" :follow org-info-open :export org-info-export
                        :store org-info-store-link)
                       ("gnus" :follow org-gnus-open :store org-gnus-store-link)
                       ("docview" :follow org-docview-open :export
                        org-docview-export :store org-docview-store-link)
                       ("bibtex" :follow org-bibtex-open :store
                        org-bibtex-store-link)
                       ("bbdb" :follow org-bbdb-open :export org-bbdb-export
                        :complete org-bbdb-complete-link :store
                        org-bbdb-store-link)
                       ("w3m" :store org-w3m-store-link) ("file+sys")
                       ("file+emacs") ("shell" :follow org-link--open-shell)
                       ("news" :follow
                        #[514 "\301\300\302\x04Q\"\207" ["news" browse-url ":"]
                          6 "\n\n(fn URL ARG)"]
                        )
                       ("mailto" :follow
                        #[514 "\301\300\302\x04Q\"\207"
                          ["mailto" browse-url ":"] 6 "\n\n(fn URL ARG)"]
                        )
                       ("https" :follow
                        #[514 "\301\300\302\x04Q\"\207" ["https" browse-url ":"]
                          6 "\n\n(fn URL ARG)"]
                        )
                       ("http" :follow
                        #[514 "\301\300\302\x04Q\"\207" ["http" browse-url ":"]
                          6 "\n\n(fn URL ARG)"]
                        )
                       ("ftp" :follow
                        #[514 "\301\300\302\x04Q\"\207" ["ftp" browse-url ":"] 6
                          "\n\n(fn URL ARG)"]
                        )
                       ("help" :follow org-link--open-help)
                       ("file" :complete org-link-complete-file)
                       ("elisp" :follow org-link--open-elisp)
                       ("doi" :follow org-link--open-doi))
 org-html-format-headline-function 'org-html-format-headline-default-function
 org-metaup-hook '(org-babel-load-in-session-maybe)
 org-use-fast-todo-selection t
 org-agenda-include-diary t
 org-link-frame-setup '((vm . vm-visit-folder-other-frame)
                        (vm-imap . vm-visit-imap-folder-other-frame)
                        (gnus . org-gnus-no-new-news) (file . find-file)
                        (wl . wl-other-frame))
 org-return-follows-link t
 org-icalendar-combined-agenda-file "~/uniCal/ics/calendar.ics"
 org-src-lang-modes '(("redis" . redis) ("php" . php) ("arduino" . arduino)
                      ("C" . c) ("C++" . c++) ("asymptote" . asy) ("bash" . sh)
                      ("beamer" . latex) ("calc" . fundamental) ("cpp" . c++)
                      ("ditaa" . artist) ("dot" . fundamental)
                      ("elisp" . emacs-lisp) ("ocaml" . tuareg)
                      ("screen" . shell-script) ("shell" . sh) ("sqlite" . sql))
 )


[-- Attachment #2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

Re: Bug: org-anniversary dates not exported to iCalendar [9.4.6 (9.4.6-3-g37f69b-elpaplus @ /home/marcus/.emacs.d/elpa/org-plus-contrib-20210531/)]

[Ihor Radchenko]

Marcus Zibrowius <marcus.zibrowius@posteo.net> writes:

> I have an org-file with entries of the form
>
> * Abel's birthday party
>   <2023-11-13>
>
> and with entries of the form
>
> * Abel Jacobi
> %%(org-anniversary 1978 11 11) Abel %d
>
> Both types of events show up in my agenda view in emacs. However, when I
> export to ics (e.g. org-export-dispatch > [c] Export to icalendar > [f]
> Current file), only the former type of entries is included in the
> resulting ics-file.

This is because Emacs diary only looks
`icalendar-export-sexp-enumeration-days' days ahead from now when
exporting non-standard diary sexps. By default, it is 2 weeks.
So, you would see the anniversary in icalendar if it were 2 weeks from
now.

You can increase `icalendar-export-sexp-enumeration-days' to get the
anniversary occurrences exported up to that number of days ahead.

Also, `org-anniversary' does not support %d. AFAIK, it is only working
for built-in sexp types, which are handled specially.

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>

Re: Bug: org-anniversary dates not exported to iCalendar [9.4.6 (9.4.6-3-g37f69b-elpaplus @ /home/marcus/.emacs.d/elpa/org-plus-contrib-20210531/)]

[Marcus Zibrowius]

[-- Attachment #1: Type: text/plain, Size: 874 bytes --]

> This is because Emacs diary only looks 
> `icalendar-export-sexp-enumeration-days' days ahead from now when 
> exporting non-standard diary sexps. By default, it is 2 weeks. 
> So, you would see the anniversary in icalendar if it were 2 weeks from 
> now.
> 
> You can increase `icalendar-export-sexp-enumeration-days' to get the 
> anniversary occurrences exported up to that number of days ahead.

The variable `icalendar-export-sexp-enumeration-days` is indeed set to 14.   However, even entries of the form 

    * Test 1
    %%(org-anniversary 2023 07 22) Test1
    * Test 2
    %%(org-anniversary 2023 07 24) Test2

do not get exported today (2023 07 23).  

> Also, `org-anniversary' does not support %d. AFAIK, it is only working 
> for built-in sexp types, which are handled specially.

    %d works perfectly in the agenda view.

Marcus 

[-- Attachment #2: Type: text/html, Size: 997 bytes --]

Re: Bug: org-anniversary dates not exported to iCalendar [9.4.6 (9.4.6-3-g37f69b-elpaplus @ /home/marcus/.emacs.d/elpa/org-plus-contrib-20210531/)]

[Ihor Radchenko]

Marcus Zibrowius <marcus.zibrowius@posteo.net> writes:

>> You can increase `icalendar-export-sexp-enumeration-days' to get the 
>> anniversary occurrences exported up to that number of days ahead.
>
> The variable `icalendar-export-sexp-enumeration-days` is indeed set to 14.   However, even entries of the form 
>
>     * Test 1
>     %%(org-anniversary 2023 07 22) Test1
>     * Test 2
>     %%(org-anniversary 2023 07 24) Test2
>
> do not get exported today (2023 07 23).  

Sure. Because anniversaries count from 1 year, not from 0.
Try 

* Test 1
%%(org-anniversary 2022 07 23) Test1
* Test 2
%%(org-anniversary 2022 07 25) Test2 %d

>> Also, `org-anniversary' does not support %d. AFAIK, it is only working 
>> for built-in sexp types, which are handled specially.
>
>     %d works perfectly in the agenda view.

You are right. And it also works in icalendar export. (Try the above
example).

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>

Re: Bug: org-anniversary dates not exported to iCalendar [9.4.6 (9.4.6-3-g37f69b-elpaplus @ /home/marcus/.emacs.d/elpa/org-plus-contrib-20210531/)]

[Marcus Zibrowius]

[-- Attachment #1: Type: text/plain, Size: 311 bytes --]

> Sure. Because anniversaries count from 1 year, not from 0.  
> Try
> 
>     * Test 1  
>     %%(org-anniversary 2022 07 23) Test1  
>     * Test 2  
>     %%(org-anniversary 2022 07 25) Test2 %d

Unfortunately, that still does not work, even with icalendar-export-sexp-enumeration-days set to 400.  

[-- Attachment #2: Type: text/html, Size: 360 bytes --]

Re: Bug: org-anniversary dates not exported to iCalendar [9.4.6 (9.4.6-3-g37f69b-elpaplus @ /home/marcus/.emacs.d/elpa/org-plus-contrib-20210531/)]

[Ihor Radchenko]

Marcus Zibrowius <marcus.zibrowius@posteo.net> writes:

>>     * Test 1  
>>     %%(org-anniversary 2022 07 23) Test1  
>>     * Test 2  
>>     %%(org-anniversary 2022 07 25) Test2 %d
>
> Unfortunately, that still does not work, even with icalendar-export-sexp-enumeration-days set to 400.  

Please provide mode details about what you tried.
I was able to export Test2 to icalendar using the latest Org version.

I did:

1. Created /tmp/bug.org

* Test 1  
%%(org-anniversary 2022 07 23) Test1  
* Test 2  
%%(org-anniversary 2022 07 25) Test2 %d

2. cd /path/to/org/repo; make repro
3. C-x C-f /tmp/bug.org <RET>
4. C-c C-e c f
5. Open /tmp/bug.ics

BEGIN:VCALENDAR
VERSION:2.0
X-WR-CALNAME:bug
PRODID:-////Emacs with Org mode//EN
X-WR-TIMEZONE:EEST
X-WR-CALDESC:
CALSCALE:GREGORIAN
BEGIN:VEVENT
UID:DS1-1ebdcf09-a392-48e2-a06a-aeecc1ff56b2
DTSTART;VALUE=DATE:20230725
DTEND;VALUE=DATE:20230726
SUMMARY:Test2 1
END:VEVENT
END:VCALENDAR

----

Test2 is exported, as expected.

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>

Re: Bug: org-anniversary dates not exported to iCalendar [9.4.6 (9.4.6-3-g37f69b-elpaplus @ /home/marcus/.emacs.d/elpa/org-plus-contrib-20210531/)]

[Marcus Zibrowius]

[-- Attachment #1: Type: text/plain, Size: 1354 bytes --]

> Please provide mode details about what you tried.  

OK, I will try.  I start emacs with 

    emacs -Q -l emacs_init/minimal-org.el

Here, minimal-org.el has the following contents:

    ;; Activate debugging.
    (setq debug-on-error t
      debug-on-signal nil
      debug-on-quit nil
      icalendar-export-sexp-enumeration-days 400)

    ;; Add latest Org mode to load path.
    (custom-set-variables
     '(package-selected-packages
       '(org-plus-contrib)))

In this setup, `M-x version` and `M-x org-version` bring up the following information:

    GNU Emacs 28.2 (build 2, x86_64-pc-linux-gnu, GTK+ Version 3.24.20, cairo version 1.16.0) of 2023-06-23

    Org mode version 9.5.5 (release_9.5.5 @ /snap/emacs/current/usr/share/emacs/28.2/lisp/org/)

`org-time-stamp` gives `<2023-07-24 Mo>`.

I create a minimal org-file `test.org` with the following contents:

    * Test 1  
    %%(org-anniversary 2022 07 23) Test1  
    * Test 2  
    %%(org-anniversary 2022 07 25) Test2 %d

I open this file in emacs and hit `C-c C-e c f` to export it to icalendar.  The file `test.ics` has the following contents:

    BEGIN:VCALENDAR
    VERSION:2.0
    X-WR-CALNAME:test
    PRODID:-//Marcus//Emacs with Org mode//EN
    X-WR-TIMEZONE:CEST
    X-WR-CALDESC:
    CALSCALE:GREGORIAN
    END:VCALENDAR



[-- Attachment #2: Type: text/html, Size: 1530 bytes --]

Re: Bug: org-anniversary dates not exported to iCalendar [9.4.6 (9.4.6-3-g37f69b-elpaplus @ /home/marcus/.emacs.d/elpa/org-plus-contrib-20210531/)]

[Ihor Radchenko]

Marcus Zibrowius <marcus.zibrowius@posteo.net> writes:

>> Please provide mode details about what you tried.  
>
> OK, I will try.  I start emacs with
> ...
>     Org mode version 9.5.5 (release_9.5.5 @ /snap/emacs/current/usr/share/emacs/28.2/lisp/org/)

I can also reproduce with this Org version.
But not with Org 9.6 (the latest release).

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>

Re: Bug: org-anniversary dates not exported to iCalendar [9.4.6 (9.4.6-3-g37f69b-elpaplus @ /home/marcus/.emacs.d/elpa/org-plus-contrib-20210531/)]

[Ihor Radchenko]

Ihor Radchenko <yantar92@posteo.net> writes:

> You can increase `icalendar-export-sexp-enumeration-days' to get the
> anniversary occurrences exported up to that number of days ahead.

I now documented this in the manual.
https://git.savannah.gnu.org/cgit/emacs/org-mode.git/commit/?id=5f7cfdfd1
Handled.

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>

Re: Bug: org-anniversary dates not exported to iCalendar [9.4.6 (9.4.6-3-g37f69b-elpaplus @ /home/marcus/.emacs.d/elpa/org-plus-contrib-20210531/)]

[Marcus Zibrowius]

[-- Attachment #1: Type: text/plain, Size: 596 bytes --]

Just to confirm:  It also works with Org 9.6 for me. Thanks for looking into this!

Marcus

On Tue, 2023-07-25 at 07:05 +0000, Ihor Radchenko wrote:
> Marcus Zibrowius <[marcus.zibrowius@posteo.net](mailto:marcus.zibrowius@posteo.net)> writes:
> 
> 
> 
> > > Please provide mode details about what you tried.  
> > 
> > 
> > OK, I will try.  I start emacs with
> > ...
> >     Org mode version 9.5.5 (release_9.5.5 @ /snap/emacs/current/usr/share/emacs/28.2/lisp/org/)
> 
> 
> I can also reproduce with this Org version.  
> But not with Org 9.6 (the latest release).
> 

[-- Attachment #2: Type: text/html, Size: 724 bytes --]