org-caldav problem; used to work

org-caldav problem; used to work

[Detlef Steuer]

Hi!

Finally I want to put my org-calendar into owncloud for easy access
everywhere.
I tried before, but had difficulties with UIDs maybe a year before
and gave up.

Nevertheless: Last time I tried the basics were easy and I had
a script working for small files. Now I get an error and am running out
of steam after a few hours of trying:


==

testtodo.org looks like this:

* Test1 
  SCHEDULED: <2014-11-20 Mi 19:00-20:00>

==

If now I enter M-x org-caldav-sync

I get the following in *Messages*

Contacting host: CORPORATESERVER:443
auth-source-search: found 1 results (max 1) matching (:max 1 :host "CORPORATESERVER:443" :port "https")
auth-source-search: found 1 CACHED results matching (:max 1 :host "CORPORATESERVER:443" :port "https")
Contacting host: CORPORATESERVER:443
org-check-agenda-file: Wrong type argument: stringp, nil
gnutls.c: [0] (Emacs) fatal error: The TLS connection was non-properly terminated.

And in *org-caldav-debug*

========== Started sync.
Check connection for https://cloud.unibw-hamburg.de/owncloud/remote.php/caldav/calendars/steuer/testtodo/.
Generating ICS file /tmp/org-caldav-70960sU.

The ICS file is empty.



My minimal init.el used for these experiments:

;;;; Org Mode ;;;
(setq load-path (cons "~/.emacs.d/org-mode/lisp" load-path))
(setq load-path (cons "~/.emacs.d/org-mode/contrib/lisp" load-path))

(require 'org)

;; The following lines are always needed.  Choose your own keys.
(add-to-list 'auto-mode-alist '("\\.org\\'" . org-mode))
(add-hook 'org-mode-hook 'turn-on-font-lock)
(global-set-key "\C-cl" 'org-store-link)
(global-set-key "\C-ca" 'org-agenda)
(global-set-key "\C-cb" 'org-iswitchb)

(setq org-directory "~/Test/Orgmodetest/CaldavKalender")
(setq org-default-notes-file (concat org-directory "/inbox.org"))
(define-key global-map "\C-cc" 'org-capture)

(setq org-agenda-files (quote("~/Test/Orgmodetest/CaldavKalender/testtodo.org")))

(require 'auth-source)
(setq auth-sources '((:source "~/.netrc" :host t :protocol t)))
(setq auth-source-debug t)

; for org-caldav
;;(setq org-icalendar-include-todo t)
;;(setq org-icalendar-use-deadline '(todo-due))
;;(setq org-icalendar-use-scheduled '(event-if-not-todo))

(setq org-icalendar-timezone "Europe/Berlin")

(setq load-path (cons "~/.emacs.d/org-caldav" load-path))

(setq org-caldav-url "https://CORPORATESERVER/owncloud/remote.php/caldav/calendars/steuer")

(setq org-caldav-calendar-id "testtodo")

(setq org-caldav-files '("~/Test/Orgmodetest/CaldavKalender/testtodo.org") )

(setq org-caldav-inbox "~/Test/Orgmodetest/CaldavKalender/caldav-inbox.org")

(require 'org-caldav)

---

emacs is invoked as
emacs -Q -l init.el testtodo.org


emacs-24.4.1
org 8.3beta from today

The server (and the paths) works. At least I can sync my mobile.

Any obvious mistake on my side?
Where does org-check-agenda-file happen?

How can I debug any further?

Any help appreciated!

Detlef

Re: org-caldav problem; used to work

[David Engster]

Detlef Steuer writes:
> org-check-agenda-file: Wrong type argument: stringp, nil

Do M-x toggle-debug-on-error before the sync and you should get a
backtrace for the error. Just post that here and we might be able to see
what's going on.

-David

Re: org-caldav problem; used to work

[Detlef Steuer]

Am Sun, 16 Nov 2014 22:53:11 +0100
schrieb David Engster <deng@randomsample.de>:

> Detlef Steuer writes:
> > org-check-agenda-file: Wrong type argument: stringp, nil
> 
> Do M-x toggle-debug-on-error before the sync and you should get a
> backtrace for the error. Just post that here and we might be able to
> see what's going on.
> 
> -David
> 

Thx David!

Here it is:

Debugger entered--Lisp error: (wrong-type-argument stringp nil)
  file-exists-p(nil)
  org-check-agenda-file(nil)
  byte-code("\302\b!\210r\303\b!q\210	\203\x13  #[(file)
"\300\301\215\207" [nextfile (byte-code "\302\b!\210r\303\b!q\210
\203\x13  mapconcat(#[(file) "\300\301\215\207" [nextfile (byte-code
"\302\b!\210r\303\b!q\210	\203\x13  org-icalendar--combine-files(nil
"~/Test/Orgmodetest/CaldavKalender/testtodo.org"
"~/Test/Orgmodetest/CaldavKalender/caldav-inbox.org")
apply(org-icalendar--combine-files nil
("~/Test/Orgmodetest/CaldavKalender/testtodo.org"
"~/Test/Orgmodetest/CaldavKalender/caldav-inbox.org")) (if (featurep
(quote ox-icalendar)) (apply (quote org-icalendar--combine-files) nil
orgfiles) (apply (quote org-export-icalendar) t orgfiles)) (let
((icalendar-file (if (featurep (quote ox-icalendar)) (quote
org-icalendar-combined-agenda-file) (quote
org-combined-agenda-icalendar-file))) (orgfiles (append
org-caldav-files (list org-caldav-inbox))) (org-icalendar-store-UID t)
(org-icalendar-include-bbdb-anniversaries nil) (icalendar-uid-format
"orgsexp-%h") (org-icalendar-date-time-format (cond ((and
org-icalendar-timezone (string= org-icalendar-timezone "UTC"))
":%Y%m%dT%H%M%SZ") (org-icalendar-timezone ";TZID=%Z:%Y%m%dT%H%M%S") (t
":%Y%m%dT%H%M%S")))) (set icalendar-file (make-temp-file
"org-caldav-")) (org-caldav-debug-print 1 (format "Generating ICS file
%s." (symbol-value icalendar-file))) (if (featurep (quote
ox-icalendar)) (apply (quote org-icalendar--combine-files) nil
orgfiles) (apply (quote org-export-icalendar) t orgfiles))
(find-file-noselect (symbol-value icalendar-file)))
org-caldav-generate-ics() (setq org-caldav-ics-buffer
(org-caldav-generate-ics)) (if (and org-caldav-event-list (y-or-n-p
"Last sync seems to have been aborted. Should I try to resume? ")) nil
(setq org-caldav-ics-buffer (org-caldav-generate-ics)) (setq
org-caldav-event-list nil) (setq org-caldav-sync-result nil)
(org-caldav-load-sync-state) (let ((--dolist-tail--
org-caldav-event-list) cur) (while --dolist-tail-- (setq cur (car
--dolist-tail--)) (org-caldav-event-set-status cur nil) (setq
--dolist-tail-- (cdr --dolist-tail--))))
(org-caldav-update-eventdb-from-org org-caldav-ics-buffer)
(org-caldav-update-eventdb-from-cal)) org-caldav-sync()
call-interactively(org-caldav-sync record nil)
command-execute(org-caldav-sync record) execute-extended-command(nil
"org-caldav-sync") call-interactively(execute-extended-command nil nil)
command-execute(execute-extended-command)


> 

Does that help?

Detlef

Re: org-caldav problem; used to work

[Rasmus]

Detlef Steuer <detlef.steuer@gmx.de> writes:

> Am Sun, 16 Nov 2014 22:53:11 +0100
> schrieb David Engster <deng@randomsample.de>:
>
>> Detlef Steuer writes:
>> > org-check-agenda-file: Wrong type argument: stringp, nil
>> 
>> Do M-x toggle-debug-on-error before the sync and you should get a
>> backtrace for the error. Just post that here and we might be able to
>> see what's going on.
>> 
>> -David
>> 
>
> Thx David!
>
> Here it is:

Try to remove nil in line 882.  I.e.:

    (apply 'org-icalendar--combine-files orgfiles)

—Rasmus

-- 
Enough with the bla bla!

Re: org-caldav problem; used to work

[David Engster]

Detlef Steuer writes:
> Am Sun, 16 Nov 2014 22:53:11 +0100
> schrieb David Engster <deng@randomsample.de>:
>
>> Detlef Steuer writes:
>> > org-check-agenda-file: Wrong type argument: stringp, nil
>> 
>> Do M-x toggle-debug-on-error before the sync and you should get a
>> backtrace for the error. Just post that here and we might be able to
>> see what's going on.
>
> Here it is:

[...]

The signature of org-icalendar--combine-files changed in
67ae102b4b. I've pushed a workaround which should fix this.

-David

Re: org-caldav problem; used to work

[Detlef Steuer]

Am Sun, 16 Nov 2014 23:37:48 +0100
schrieb David Engster <deng@randomsample.de>:

> The signature of org-icalendar--combine-files changed in
> 67ae102b4b. I've pushed a workaround which should fix this.

Thank you! I can confirm that fixes the reported issue, i.e.
my test appointments are exported and show up in the owncloud´s calendar.

Fine!

But there was a new Problem: A new set of UIDs got created when I edited
my test data. (removed the SCHEDLULED key-word)

--- Before (result of first test export)

* APPT Test1 
  SCHEDULED: <2014-11-12 Mi 19:00-20:00>
  :PROPERTIES:
  :ID:       dc432cb8-ab29-4bf0-8ea0-e40ca8e8850d
  :END:

* APPT Test2
  SCHEDULED: <2014-11-16 So 23:00-24:00>
  :PROPERTIES:
  :ID:       ec46076b-e1d9-453b-8e63-317e6ff64b0e
  :END:
  

* APPT Test3
  SCHEDULED: <2014-11-17 Mo 23:00-24:00>
  :PROPERTIES:
  :ID:       c28a7aa7-9c93-4d94-9f85-d563d933bb35
  :END:
  
---

removed SCHEDULED 

--- After

* APPT Test1 
  :PROPERTIES:
  :ID:       867c4f4e-9c7f-4d39-9404-f9dadb25edd9
  :END:
  <2014-11-12 Mi 19:00-20:00>
  :PROPERTIES:
  :ID:       dc432cb8-ab29-4bf0-8ea0-e40ca8e8850d
  :END:

* APPT Test2
  :PROPERTIES:
  :ID:       4961e4b3-cb9b-4247-b4f5-4e27cb2d1ee1
  :END:
  <2014-11-16 So 23:00-24:00>
  :PROPERTIES:
  :ID:       ec46076b-e1d9-453b-8e63-317e6ff64b0e
  :END:
  

* APPT Test3
  :PROPERTIES:
  :ID:       5cc68445-4829-4672-863b-3b4bb7346f11
  :END:
  <2014-11-17 Mo 23:00-24:00>
  :PROPERTIES:
  :ID:       c28a7aa7-9c93-4d94-9f85-d563d933bb35
  :END:
  
---

Detlef

> 
> -David

Re: org-caldav problem; used to work

[Detlef Steuer]

Am Sun, 16 Nov 2014 23:24:24 +0100
schrieb Rasmus <rasmus@gmx.us>:

> Detlef Steuer <detlef.steuer@gmx.de> writes:
> 
> > Am Sun, 16 Nov 2014 22:53:11 +0100
> > schrieb David Engster <deng@randomsample.de>:
> >
> >> Detlef Steuer writes:
> >> > org-check-agenda-file: Wrong type argument: stringp, nil
> >> 
> >> Do M-x toggle-debug-on-error before the sync and you should get a
> >> backtrace for the error. Just post that here and we might be able
> >> to see what's going on.
> >> 
> >> -David
> >> 
> >
> > Thx David!
> >
> > Here it is:
> 
> Try to remove nil in line 882.  I.e.:
> 
>     (apply 'org-icalendar--combine-files orgfiles)

Yeah. Spot-on! Worked, but David`s fix also arrived before I could send
this reply. 

Thx a lot!

Detlef


> 
> —Rasmus
> 

Re: org-caldav problem; used to work

[Nicolas Goaziou]

Hello,

Detlef Steuer <detlef.steuer@gmx.de> writes:

> But there was a new Problem: A new set of UIDs got created when I edited
> my test data. (removed the SCHEDLULED key-word)
>
> --- Before (result of first test export)
>
> * APPT Test1 
>   SCHEDULED: <2014-11-12 Mi 19:00-20:00>
>   :PROPERTIES:
>   :ID:       dc432cb8-ab29-4bf0-8ea0-e40ca8e8850d
>   :END:

[...]

> removed SCHEDULED

A properties drawer needs to be the second element in the entry,
planning info being the first, or the first one if there is no planning
info.

If you remove "SCHEDULED:", you also remove planning info only to leave
a plain timestamp (in a paragraph, but that doesn't matter here). The
properties drawer is no longer correctly located in your entry: it
becomes a regular drawer named "PROPERTIES".

As a consequence, ox-icalendar can no longer recognize entry's ID and
creates a new one, correctly located this time, before next export:

> --- After
>
> * APPT Test1 
>   :PROPERTIES:
>   :ID:       867c4f4e-9c7f-4d39-9404-f9dadb25edd9
>   :END:
>   <2014-11-12 Mi 19:00-20:00>
>   :PROPERTIES:
>   :ID:       dc432cb8-ab29-4bf0-8ea0-e40ca8e8850d
>   :END:

Long story short: if you remove "SCHEDULED:", also move the timestamp
/after/ the drawer.


Regards,

-- 
Nicolas Goaziou