unofficial mirror of guix-devel@gnu.org 
 help / color / mirror / code / Atom feed
* [PATCH] import: github: Catch HTTP 403 error during fetch.
@ 2017-01-17  8:17 Mathieu OTHACEHE
  2017-01-19 16:19 ` Ludovic Courtès
  0 siblings, 1 reply; 2+ messages in thread
From: Mathieu OTHACEHE @ 2017-01-17  8:17 UTC (permalink / raw)
  To: guix-devel

* guix/import/github.scm (json-fetch*): Catch 403 HTTP error that may be
  raised if a github token has not been set.

Signed-off-by: Mathieu OTHACEHE <m.othacehe@gmail.com>
---

Hi,

If too many github requests are made during a guix refresh (> 60/h),
github will reject all further requests with a 403 error.

The 403 error is not catch in json-fetch* guard, so guix refresh
will exit at that point. The user never gets to error message
informing that setting a GUIX_GITHUB_TOKEN may fix the problem.

Mathieu

 guix/import/github.scm | 9 ++++++---
 1 file changed, 6 insertions(+), 3 deletions(-)

diff --git a/guix/import/github.scm b/guix/import/github.scm
index df5a6b0e0..1e0bb53d9 100644
--- a/guix/import/github.scm
+++ b/guix/import/github.scm
@@ -32,10 +32,13 @@
 
 (define (json-fetch* url)
   "Return a representation of the JSON resource URL (a list or hash table), or
-#f if URL returns 404."
+#f if URL returns 403 or 404."
   (guard (c ((and (http-get-error? c)
-                  (= 404 (http-get-error-code c)))
-             #f))                       ;"expected" if package is unknown
+                  (let ((error (http-get-error-code c)))
+                    (or (= 403 error)
+                        (= 404 error))))
+             #f))     ;; "expected" if there is an authentification error (403),
+                      ;; or if package is unknown (404).
     ;; Note: github.com returns 403 if we omit a 'User-Agent' header.
     (let* ((port   (http-fetch url))
            (result (json->scm port)))
-- 
2.11.0

^ permalink raw reply related	[flat|nested] 2+ messages in thread

* Re: [PATCH] import: github: Catch HTTP 403 error during fetch.
  2017-01-17  8:17 [PATCH] import: github: Catch HTTP 403 error during fetch Mathieu OTHACEHE
@ 2017-01-19 16:19 ` Ludovic Courtès
  0 siblings, 0 replies; 2+ messages in thread
From: Ludovic Courtès @ 2017-01-19 16:19 UTC (permalink / raw)
  To: Mathieu OTHACEHE; +Cc: guix-devel

Mathieu OTHACEHE <m.othacehe@gmail.com> skribis:

> * guix/import/github.scm (json-fetch*): Catch 403 HTTP error that may be
>   raised if a github token has not been set.
>
> Signed-off-by: Mathieu OTHACEHE <m.othacehe@gmail.com>
> ---
>
> Hi,
>
> If too many github requests are made during a guix refresh (> 60/h),
> github will reject all further requests with a 403 error.
>
> The 403 error is not catch in json-fetch* guard, so guix refresh
> will exit at that point. The user never gets to error message
> informing that setting a GUIX_GITHUB_TOKEN may fix the problem.

Looks like the right to do indeed.  Applied, thanks!

Ludo’.

^ permalink raw reply	[flat|nested] 2+ messages in thread

end of thread, other threads:[~2017-01-19 16:19 UTC | newest]

Thread overview: 2+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2017-01-17  8:17 [PATCH] import: github: Catch HTTP 403 error during fetch Mathieu OTHACEHE
2017-01-19 16:19 ` Ludovic Courtès

Code repositories for project(s) associated with this public inbox

	https://git.savannah.gnu.org/cgit/guix.git

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).