* Very Small Atom Feed Reader
@ 2016-03-06 14:12 Amirouche Boubekki
2016-03-06 15:13 ` Luis Felipe López Acevedo
` (3 more replies)
0 siblings, 4 replies; 7+ messages in thread
From: Amirouche Boubekki @ 2016-03-06 14:12 UTC (permalink / raw)
To: Guile User
[-- Attachment #1: Type: text/plain, Size: 327 bytes --]
Héllo,
I share with you this small *atom* feed reader which works from command
line. Create a ~/.prime.txt file with the address of atom files you want
to follow and then run the script.
The problem I have is that it fails on wingolog and others but I'm
accepting patches ;)
--
Amirouche ~ amz3 ~ http://www.hyperdev.fr
[-- Attachment #2: main.scm --]
[-- Type: text/plain, Size: 5664 bytes --]
(use-modules (srfi srfi-9))
(use-modules (srfi srfi-19))
(use-modules (srfi srfi-26))
(use-modules (ice-9 match))
(use-modules (ice-9 rdelim))
(use-modules (ice-9 receive))
(use-modules (sxml xpath))
(use-modules (sxml simple))
(use-modules (srfi srfi-1))
(use-modules (web client))
;; XXX: this is required for some reason
(setlocale LC_ALL "")
;;; srfi-999
(define-syntax define-record-type*
(lambda (x)
(define (%id-name name) (string->symbol (string-drop
(string-drop-right
(symbol->string name) 1) 1)))
(define (id-name ctx name)
(datum->syntax ctx (%id-name (syntax->datum name))))
(define (id-append ctx . syms)
(datum->syntax ctx (apply symbol-append (map syntax->datum syms))))
(syntax-case x ()
((_ rname field ...)
(and (identifier? #'rname) (and-map identifier? #'(field ...)))
(with-syntax ((cons (id-append #'rname #'make- (id-name #'rname #'rname)))
(pred (id-append #'rname (id-name #'rname #'rname) #'?))
((getter ...) (map (lambda (f)
(id-append f (id-name #'rname #'rname) #'- f))
#'(field ...))))
#'(define-record-type rname
(cons field ...)
pred
(field getter)
...))))))
;;; sxml procedures
(define (file->sxml filename)
(cdr (xml->sxml (with-input-from-file filename
(lambda ()
(read-string))))))
(define (url-fetch url)
(pk url)
(receive (_ body) (http-get url) body))
;; helpers to turn atom into scheme
(define (sxml->date sxml)
;; FIXME: add support for TZ
(let* ((timestamp (car ((sxpath '(http://www.w3.org/2005/Atom:updated *text*)) sxml)))
(length (string-length "2015-08-13T00:24:00"))
(date (string->date (string-take timestamp length) "~Y-~m-~dT~H:~M:~S")))
;; date))
timestamp))
(define (sxml->feed sxml)
(map (lambda (spec) (cons (car spec) ((cadr spec) sxml)))
`((title ,(sxpath '(http://www.w3.org/2005/Atom:id *text*)))
(updated-at ,sxml->date)
(author ,(sxpath '(http://www.w3.org/2005/Atom:author http://www.w3.org/2005/Atom:name *text*)))
;; XXX: can't retrieve a url node because the attribute axis `equal?``match all the children
;; instead of testing the existance of the provided pair.
;; XXX: the following should match the "href" attribute value of the "alternate" link node
;; (url ,(sxpath '(http://www.w3.org/2005/Atom:link (@ (equal? (rel "alternate"))) @ href *text*)))
(entries ,(sxpath '(http://www.w3.org/2005/Atom:entry))))))
;; borrowed from guix
(define* (string-replace-substring str substr replacement
#:optional
(start 0)
(end (string-length str)))
"Replace all occurrences of SUBSTR in the START--END range
of STR by REPLACEMENT."
(match (string-length substr)
(0
(error "string-replace-substring: empty substring"))
(substr-length
(let loop ((start start)
(pieces (list (substring str 0 start))))
(match (string-contains str substr start end)
(#f
(string-concatenate-reverse
(cons (substring str start) pieces)))
(index
(loop (+ index substr-length)
(cons* replacement
(substring str start index)
pieces))))))))
;; borrowed from haunt
(define (unescape str)
(define *escape-map* '(("<". "<")
(">" . ">")
("&" . "&")
(""" . "\"")))
(fold (lambda (escape str)
(string-replace-substring str (car escape) (cdr escape)))
str
*escape-map*))
(define (sxml->summary sxml)
(define summary->string
(compose cdr xml->sxml unescape car (sxpath '(http://www.w3.org/2005/Atom:summary *text*))))
(catch #true
(lambda () (summary->string sxml))
(lambda (key . args) "")))
(define (sxml->entry sxml)
(map (lambda (spec) (cons (car spec) ((cdr spec) sxml)))
`((title . ,(compose car (sxpath '(http://www.w3.org/2005/Atom:title *text*))))
(url . ,(compose car (sxpath '(http://www.w3.org/2005/Atom:link @ href *text*))))
;; (summary . ,sxml->summary)
(updated-at . ,sxml->date)
;; (uid . ,(compose car (sxpath '(http://www.w3.org/2005/Atom:id *text*))))
)))
(define url->feed (compose sxml->feed cdr xml->sxml url-fetch))
(define (url->entries url)
(map sxml->entry (assoc-ref (url->feed url) 'entries)))
(define (feeds)
(let ((prime.txt (string-join (list (getenv "HOME") ".prime.txt") "/")))
(call-with-input-file prime.txt
(lambda (port)
(let loop ((line (read-line port))
(out '()))
(if (eof-object? line)
out
(loop (read-line port) (cons line out))))))))
(define (sort-entries a b)
(string>? (assoc-ref a 'updated-at) (assoc-ref b 'updated-at)))
(define (format-entry entry)
(format #t "* ~a\n** ~a\n** ~a\n\n"
(assoc-ref entry 'title)
(assoc-ref entry 'url)
(assoc-ref entry 'updated-at)))
(map format-entry (sort (append-map url->entries (feeds)) sort-entries))
;; .prime.txt content
;;
;; http://savannah.gnu.org/news/atom.php?group=guix
;; http://savannah.gnu.org/news/atom.php?group=guile
;; http://dustycloud.org/blog/index.xml
^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: Very Small Atom Feed Reader
2016-03-06 14:12 Very Small Atom Feed Reader Amirouche Boubekki
@ 2016-03-06 15:13 ` Luis Felipe López Acevedo
2016-03-13 11:29 ` Amirouche Boubekki
2016-03-06 15:15 ` Nala Ginrut
` (2 subsequent siblings)
3 siblings, 1 reply; 7+ messages in thread
From: Luis Felipe López Acevedo @ 2016-03-06 15:13 UTC (permalink / raw)
To: Amirouche Boubekki; +Cc: Guile User
On 2016-03-06 09:12, Amirouche Boubekki wrote:
> Héllo,
Hi, Amirouche :)
> I share with you this small *atom* feed reader which works from
> command line. Create a ~/.prime.txt file with the address of atom
> files you want to follow and then run the script.
I tried it and it works with my atom feed. But my posts in Spanish and
other languages that use non-ASCII characters don't display correctly.
For example, I get titles like "Danza de Salomé", but it should be
"Danza de Salomé". This is my atom feed in Spanish:
http://sirgazil.bitbucket.org/es/blog/activity.atom.
> The problem I have is that it fails on wingolog and others but I'm
> accepting patches ;)
FWIW, atom feeds generated by Tekuti
(https://wingolog.org/projects/tekuti/) used to fail for me too, not
long ago, using different readers (Liferea, for example). It seems to be
something that comes and goes. I initially had intermittent errors
reported by Liferea when reading Wingo's and Nala's feeds, but they are
working normally now (I'm using Liferea).
--
Luis Felipe López Acevedo
http://sirgazil.bitbucket.org/
^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: Very Small Atom Feed Reader
2016-03-06 14:12 Very Small Atom Feed Reader Amirouche Boubekki
2016-03-06 15:13 ` Luis Felipe López Acevedo
@ 2016-03-06 15:15 ` Nala Ginrut
2016-03-07 9:37 ` Ludovic Courtès
2016-03-13 10:42 ` Alex Kost
3 siblings, 0 replies; 7+ messages in thread
From: Nala Ginrut @ 2016-03-06 15:15 UTC (permalink / raw)
To: Amirouche Boubekki, Guile User
[-- Attachment #1: Type: text/plain, Size: 605 bytes --]
Cool! I'm planning a tekuti compatible blog engine based on Artanis.
Because I want to port my blog to Artanis. An inspirable Atom module is
helpful for this.
Amirouche Boubekki <amirouche@hypermove.net>于2016年3月6日周日 22:12写道:
> Héllo,
>
> I share with you this small *atom* feed reader which works from command
> line. Create a ~/.prime.txt file with the address of atom files you want
> to follow and then run the script.
>
> The problem I have is that it fails on wingolog and others but I'm
> accepting patches ;)
>
> --
> Amirouche ~ amz3 ~ http://www.hyperdev.fr
[-- Attachment #2: Type: text/html, Size: 945 bytes --]
^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: Very Small Atom Feed Reader
2016-03-06 14:12 Very Small Atom Feed Reader Amirouche Boubekki
2016-03-06 15:13 ` Luis Felipe López Acevedo
2016-03-06 15:15 ` Nala Ginrut
@ 2016-03-07 9:37 ` Ludovic Courtès
2016-03-13 10:42 ` Alex Kost
3 siblings, 0 replies; 7+ messages in thread
From: Ludovic Courtès @ 2016-03-07 9:37 UTC (permalink / raw)
To: guile-user
Amirouche Boubekki <amirouche@hypermove.net> skribis:
> I share with you this small *atom* feed reader which works from
> command line. Create a ~/.prime.txt file with the address of atom
> files you want to follow and then run the script.
FWIW here’s the one used on the web sites of Guile and Guix to extract
news entries from the Atom feed and render them on the home page:
http://git.savannah.gnu.org/cgit/guile/guile-web.git/tree/website/apps/base/news.scm
Ludo’.
^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: Very Small Atom Feed Reader
2016-03-06 14:12 Very Small Atom Feed Reader Amirouche Boubekki
` (2 preceding siblings ...)
2016-03-07 9:37 ` Ludovic Courtès
@ 2016-03-13 10:42 ` Alex Kost
2016-03-13 11:20 ` Amirouche Boubekki
3 siblings, 1 reply; 7+ messages in thread
From: Alex Kost @ 2016-03-13 10:42 UTC (permalink / raw)
To: Amirouche Boubekki; +Cc: Guile User
Amirouche Boubekki (2016-03-06 17:12 +0300) wrote:
> Héllo,
Hi there!
> I share with you this small *atom* feed reader which works from command
> line. Create a ~/.prime.txt file with the address of atom files you want
> to follow and then run the script.
>
> The problem I have is that it fails on wingolog and others but I'm
> accepting patches ;)
> (use-modules (srfi srfi-9))
> (use-modules (srfi srfi-19))
> (use-modules (srfi srfi-26))
> (use-modules (ice-9 match))
> (use-modules (ice-9 rdelim))
> (use-modules (ice-9 receive))
> (use-modules (sxml xpath))
> (use-modules (sxml simple))
> (use-modules (srfi srfi-1))
> (use-modules (web client))
Why do you use 'use-modules' for every module instead of:
(use-modules (srfi srfi-1)
(srfi srfi-9)
...)
[...]
> ;;; sxml procedures
> (define (file->sxml filename)
> (cdr (xml->sxml (with-input-from-file filename
> (lambda ()
> (read-string))))))
No need in lambda here, just: (with-input-from-file filename read-string)
--
Alex
^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: Very Small Atom Feed Reader
2016-03-13 10:42 ` Alex Kost
@ 2016-03-13 11:20 ` Amirouche Boubekki
0 siblings, 0 replies; 7+ messages in thread
From: Amirouche Boubekki @ 2016-03-13 11:20 UTC (permalink / raw)
To: Alex Kost; +Cc: Guile User
Le 2016-03-13 11:42, Alex Kost a écrit :
> Amirouche Boubekki (2016-03-06 17:12 +0300) wrote:
>
>> Héllo,
>
> Hi there!
>
>> I share with you this small *atom* feed reader which works from
>> command
>> line. Create a ~/.prime.txt file with the address of atom files you
>> want
>> to follow and then run the script.
>>
>> The problem I have is that it fails on wingolog and others but I'm
>> accepting patches ;)
>
>> (use-modules (srfi srfi-9))
>> (use-modules (srfi srfi-19))
>> (use-modules (srfi srfi-26))
>
>> (use-modules (ice-9 match))
>> (use-modules (ice-9 rdelim))
>> (use-modules (ice-9 receive))
>
>> (use-modules (sxml xpath))
>> (use-modules (sxml simple))
>
>> (use-modules (srfi srfi-1))
>
>> (use-modules (web client))
>
> Why do you use 'use-modules' for every module instead of:
>
> (use-modules (srfi srfi-1)
> (srfi srfi-9)
> ...)
Because it's easier to type...
> [...]
>> ;;; sxml procedures
>
>> (define (file->sxml filename)
>> (cdr (xml->sxml (with-input-from-file filename
>> (lambda ()
>> (read-string))))))
>
> No need in lambda here, just: (with-input-from-file filename
> read-string)
Thanks.
--
Amirouche ~ amz3 ~ http://www.hyperdev.fr
^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: Very Small Atom Feed Reader
2016-03-06 15:13 ` Luis Felipe López Acevedo
@ 2016-03-13 11:29 ` Amirouche Boubekki
0 siblings, 0 replies; 7+ messages in thread
From: Amirouche Boubekki @ 2016-03-13 11:29 UTC (permalink / raw)
To: Luis Felipe López Acevedo, Amirouche Boubekki; +Cc: Guile User
[-- Attachment #1: Type: text/plain, Size: 1484 bytes --]
On Sun, Mar 6, 2016 at 4:14 PM Luis Felipe López Acevedo <
felipe.lopez@openmailbox.org> wrote:
> On 2016-03-06 09:12, Amirouche Boubekki wrote:
> > Héllo,
>
>
> Hi, Amirouche :)
>
>
> > I share with you this small *atom* feed reader which works from
> > command line. Create a ~/.prime.txt file with the address of atom
> > files you want to follow and then run the script.
>
>
> I tried it and it works with my atom feed. But my posts in Spanish and
> other languages that use non-ASCII characters don't display correctly.
> For example, I get titles like "Danza de Salomé", but it should be
> "Danza de Salomé". This is my atom feed in Spanish:
> http://sirgazil.bitbucket.org/es/blog/activity.atom.
>
I have the same issue, I don't understand (setlocale LC_ALL "") is meant to
fix that problem.
https://www.gnu.org/software/guile/manual/html_node/Locales.html#index-setlocale
> > The problem I have is that it fails on wingolog and others but I'm
> > accepting patches ;)
>
> FWIW, atom feeds generated by Tekuti
> (https://wingolog.org/projects/tekuti/) used to fail for me too, not
> long ago, using different readers (Liferea, for example). It seems to be
> something that comes and goes. I initially had intermittent errors
> reported by Liferea when reading Wingo's and Nala's feeds, but they are
> working normally now (I'm using Liferea).
>
You are right, at the present time firefox can't display the feed of
wingolog.
[-- Attachment #2: Type: text/html, Size: 2324 bytes --]
^ permalink raw reply [flat|nested] 7+ messages in thread
end of thread, other threads:[~2016-03-13 11:29 UTC | newest]
Thread overview: 7+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2016-03-06 14:12 Very Small Atom Feed Reader Amirouche Boubekki
2016-03-06 15:13 ` Luis Felipe López Acevedo
2016-03-13 11:29 ` Amirouche Boubekki
2016-03-06 15:15 ` Nala Ginrut
2016-03-07 9:37 ` Ludovic Courtès
2016-03-13 10:42 ` Alex Kost
2016-03-13 11:20 ` Amirouche Boubekki
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).