From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Tomas Hlavaty Newsgroups: gmane.emacs.help Subject: Re: Workshop to save M$ Windows users - help needed Date: Mon, 04 Oct 2021 19:34:46 +0200 Message-ID: <87h7dwy9qh.fsf@logand.com> References: <837deua1sd.fsf@gnu.org> <834k9y9ysj.fsf@gnu.org> <87r1d151x1.fsf@logand.com> Mime-Version: 1.0 Content-Type: text/plain Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="18509"; mail-complaints-to="usenet@ciao.gmane.io" Cc: help-gnu-emacs To: Eduardo Ochs Original-X-From: help-gnu-emacs-bounces+geh-help-gnu-emacs=m.gmane-mx.org@gnu.org Mon Oct 04 19:36:08 2021 Return-path: Envelope-to: geh-help-gnu-emacs@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1mXRsl-0004Yk-UK for geh-help-gnu-emacs@m.gmane-mx.org; Mon, 04 Oct 2021 19:36:07 +0200 Original-Received: from localhost ([::1]:37128 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1mXRsk-0006l2-9T for geh-help-gnu-emacs@m.gmane-mx.org; Mon, 04 Oct 2021 13:36:06 -0400 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]:42472) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mXRri-0006jb-7k for help-gnu-emacs@gnu.org; Mon, 04 Oct 2021 13:35:02 -0400 Original-Received: from logand.com ([37.48.87.44]:33284) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mXRrg-0002RB-0Y for help-gnu-emacs@gnu.org; Mon, 04 Oct 2021 13:35:01 -0400 Original-Received: by logand.com (Postfix, from userid 1001) id 0C33219EB31; Mon, 4 Oct 2021 19:34:49 +0200 (CEST) X-Mailer: emacs 27.2 (via feedmail 11-beta-1 I) In-Reply-To: Received-SPF: pass client-ip=37.48.87.44; envelope-from=tom@logand.com; helo=logand.com X-Spam_score_int: -18 X-Spam_score: -1.9 X-Spam_bar: - X-Spam_report: (-1.9 / 5.0 requ) BAYES_00=-1.9, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: help-gnu-emacs@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Users list for the GNU Emacs text editor List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: help-gnu-emacs-bounces+geh-help-gnu-emacs=m.gmane-mx.org@gnu.org Original-Sender: "help-gnu-emacs" Xref: news.gmane.io gmane.emacs.help:133542 Archived-At: On Mon 04 Oct 2021 at 00:06, Eduardo Ochs wrote: > On Sun, 3 Oct 2021 at 16:44, Tomas Hlavaty wrote: >> >> Emacs should be able to download the files even on Windows without >> installing wget, e.g. this should work: >> >> (eww "http://www.gnu.org/software/emacs/emacs-paper.html") >> >> There is a variable url-cache-directory suggesting that caching can >> happen transparently. Maybe you could even supply your own >> url-cache-creation-function. Or figure out what functions you could >> reuse to simulate wget and your caching strategy in pure Emacs more >> closely. >> >> I know you want to do it manually, but why bother beginners with that? > > > Hi Tomas, > > I've tried to implement something like what you are proposing. It > seems that the right tool for that, at least for the simplest > cases, is `url-retrieve-synchronously'. It is documented here: > > (find-node "(url)Retrieving URLs") > (find-node "(url)Retrieving URLs" "url-retrieve-synchronously") > (find-node "(url)Dealing with HTTP documents") > > Straight.el uses `url-retrieve-synchronously' here: > > https://github.com/raxod502/straight.el#getting-started > > Try this: > > (find-ebuffer > (url-retrieve-synchronously > "https://raw.githubusercontent.com/raxod502/straight.el/develop/install.el" > 'silent 'inhibit-cookies) > "\n\n") > > The "\n\n" will put the point after the response headers. > > I thought that it would be trivial to write a "fake wget" for > eshell using `url-retrieve-synchronously'. The part of adding a > new builting seems to be easy, see: > > (find-node "(eshell)Built-ins" "eshell/ls") > (find-eshellfile "") > (find-eshellgrep "grep --color=auto -nH --null -e eshell/ *.el") > > but I couldn't get the error checking right, and at some point I > stopped trying. Then I saw this thread, > > https://lists.gnu.org/archive/html/emacs-devel/2021-03/threads.html#01359 > > and it convinced me that using a real wget would be the right > thing to do. > > I have some code for playing with url-retrieve here, if you'd > like to try: > > http://angg.twu.net/elisp/url-retrieve-test.el > http://angg.twu.net/elisp/url-retrieve-test.el.html > (find-wgeta-elisp "http://angg.twu.net/elisp/url-retrieve-test.el") > > Cheers, > Eduardo Ochs > http://angg.twu.net/#eev I see, url-retrieve-synchronously is a beast. You could write something simpler and keep track of the status. Something like: ;;; -*- lexical-binding: t -*- (defun url-retrieve-synchronously2 (url filename) (let ((b (find-file filename)) z (again t)) (cl-flet ((save (status done) ;;(message "save %s %s" status done) (setq z status) (if done (setq again nil) (when status (with-current-buffer b (let ((coding-system-for-write 'raw-text-unix)) (write-region (point-min) (point-max) filename))))))) (with-current-buffer b (url-retrieve url #'save '(t))) (while again (save nil nil) (sleep-for 1)) ;;(message "done") z))) (url-retrieve-synchronously2 "https://logand.com" "/tmp/e2") (url-retrieve-synchronously2 "https://logand.com1" "/tmp/e2") This works for me (saves whole http response), returns plist and saves the data into file on success, otherwise on failure returns nil. Anyway, I was trying to suggest something even simpler: use eww and customize it so that it caches the downloaded files. This is what you are doing in shell manually. Or even better, bind for example M-f to ffap so that people can simply press M-f on a url and Emacs will take them there.