From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!not-for-mail From: Ivan Shmakov Newsgroups: gmane.emacs.bugs Subject: bug#18812: 24.4; url.el user agent does not include Emacs version Date: Fri, 24 Oct 2014 19:17:48 +0000 Message-ID: <87oat1e0pv.fsf@violet.siamics.net> References: <87fveexyjb.fsf@enigma.home.hagelb.org> NNTP-Posting-Host: plane.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Trace: ger.gmane.org 1414178304 26010 80.91.229.3 (24 Oct 2014 19:18:24 GMT) X-Complaints-To: usenet@ger.gmane.org NNTP-Posting-Date: Fri, 24 Oct 2014 19:18:24 +0000 (UTC) To: 18812@debbugs.gnu.org Original-X-From: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane.org@gnu.org Fri Oct 24 21:18:18 2014 Return-path: Envelope-to: geb-bug-gnu-emacs@m.gmane.org Original-Received: from lists.gnu.org ([208.118.235.17]) by plane.gmane.org with esmtp (Exim 4.69) (envelope-from ) id 1XhkNN-0002Yx-PR for geb-bug-gnu-emacs@m.gmane.org; Fri, 24 Oct 2014 21:18:17 +0200 Original-Received: from localhost ([::1]:50205 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1XhkNN-0006gi-Bs for geb-bug-gnu-emacs@m.gmane.org; Fri, 24 Oct 2014 15:18:17 -0400 Original-Received: from eggs.gnu.org ([2001:4830:134:3::10]:44650) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1XhkNG-0006gN-RU for bug-gnu-emacs@gnu.org; Fri, 24 Oct 2014 15:18:15 -0400 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1XhkN9-00043J-Hp for bug-gnu-emacs@gnu.org; Fri, 24 Oct 2014 15:18:10 -0400 Original-Received: from debbugs.gnu.org ([140.186.70.43]:42203) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1XhkN9-000438-6y for bug-gnu-emacs@gnu.org; Fri, 24 Oct 2014 15:18:03 -0400 Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.80) (envelope-from ) id 1XhkN8-0003XB-Gx for bug-gnu-emacs@gnu.org; Fri, 24 Oct 2014 15:18:02 -0400 X-Loop: help-debbugs@gnu.org Resent-From: Ivan Shmakov Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Fri, 24 Oct 2014 19:18:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 18812 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: Original-Received: via spool by 18812-submit@debbugs.gnu.org id=B18812.141417828113578 (code B ref 18812); Fri, 24 Oct 2014 19:18:02 +0000 Original-Received: (at 18812) by debbugs.gnu.org; 24 Oct 2014 19:18:01 +0000 Original-Received: from localhost ([127.0.0.1]:34301 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1XhkN6-0003Wv-9J for submit@debbugs.gnu.org; Fri, 24 Oct 2014 15:18:00 -0400 Original-Received: from fely.am-1.org ([78.47.74.50]:37345) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1XhkN3-0003Wm-Nl for 18812@debbugs.gnu.org; Fri, 24 Oct 2014 15:17:58 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=siamics.net; s=a2013295; h=Content-Transfer-Encoding:Content-Type:MIME-Version:Message-ID:In-Reply-To:Date:Sender:References:Subject:To:From; bh=QM8MaHRlDsz5zYUCF6f3sx/qxYrOku/Fpil7B+M6z/E=; b=BUOISZX8Qi3sNBIbMTK6MCDJo6v5u16lCPTV05kyQ3l7QFoDwnp7ro8B2aVeu+4BE0HZBlJ9DrTlLY1IdV7Qq2lqHDH3KuppaacE/kG1tQk/0AN3IXR+DHxYTYD5xFcbuuY7/5WHkurDWho8iENjdFkDeyxyUPvsQDPqDcoeTxg=; Original-Received: from [2a02:2560:6d4:26ca::1:1d] (helo=violet.siamics.net) by fely.am-1.org with esmtps (TLS1.2:DHE_RSA_AES_128_CBC_SHA1:128) (Exim 4.80) (envelope-from ) id 1XhkN1-0000Ow-Nl for 18812@debbugs.gnu.org; Fri, 24 Oct 2014 19:17:56 +0000 Original-Received: from localhost ([::1] helo=violet.siamics.net) by violet.siamics.net with esmtps (TLS1.2:RSA_AES_128_CBC_SHA1:128) (Exim 4.80) (envelope-from ) id 1XhkMu-0005oF-NT for 18812@debbugs.gnu.org; Sat, 25 Oct 2014 02:17:48 +0700 In-Reply-To: (Ted Zlatanov's message of "Fri, 24 Oct 2014 09:48:11 -0400") User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.3 (gnu/linux) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list X-detected-operating-system: by eggs.gnu.org: GNU/Linux 3.x X-Received-From: 140.186.70.43 X-BeenThere: bug-gnu-emacs@gnu.org List-Id: "Bug reports for GNU Emacs, the Swiss army knife of text editors" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane.org@gnu.org Original-Sender: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane.org@gnu.org Xref: news.gmane.org gmane.emacs.bugs:95039 >>>>> "TZ" =3D=3D Ted Zlatanov writes: >>>>> On Thu, 23 Oct 2014 21:19:21 -0400 Stefan Monnier wrote: PH> The url.el functions for making HTTP requests set the User-Agent PH> header to "URL/Emacs" which is not very descriptive. It would be PH> helpful to include the Emacs version, at least. SM> Other people feel like it's already too descriptive. Why should SM> all Emacs users constantly tell the whole world exactly which Emacs SM> version they're running? TZ> Web browsers do. It helps web developers and is not particularly TZ> sensitive if only the major.minor version is used (without too much TZ> detail). Web browsers (and HTTP/HTTPS clients in general) also provide a way for the user to override the default User-Agent: value, and I believe that Emacs should allow for that, too. While somewhat tangential to the problem as reported, some of the issues I=E2=80=99ve seen with the default User-Agent: settings are: =E2=80=A2 Lynx=E2=80=99 default User-Agent: includes =E2=80=98libwww=E2=80= =99 as a substring; apparently, some Web sites mistake that for the well-known Perl library of the same name, and thus reject the requests; the solution is to either manually remove the respective stanza, or to disable User-Agent: altogether; =E2=80=A2 other sites are known to disallow HTTP requests /without/ User-Agent:, however; =E2=80=A2 GNU Wget default identification is also not unknown to be rejected; per my experience, using something like =E2=80=9CtegW/1.15=E2= =80=9D instead (via --user-agent=3D) tends to resolve the issue; =E2=80=A2 moreover, some sites actually serve different content depending on User-Agent:, =E2=80=93 apparently for =E2=80=9CSEO=E2=80=9D= purposes; for instance, a PDF file is served for a request from a party identifying itself as a search engine, while regular browsers get a Web page with a (presumably non-free) JavaScript-based PDF reader set up for that file instead. --=20 FSF associate member #7257 http://boycottsystemd.org/ =E2=80=A6 3013 B6A0= 230E 334A