From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!.POSTED!not-for-mail From: Katsumi Yamaoka Newsgroups: gmane.emacs.bugs Subject: bug#33133: 26.1.50; zlib-decompress-region too rigid Date: Wed, 24 Oct 2018 08:07:50 +0900 Organization: Emacsen advocacy group Message-ID: NNTP-Posting-Host: blaine.gmane.org Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="=-=-=" X-Trace: blaine.gmane.org 1540336094 578 195.159.176.226 (23 Oct 2018 23:08:14 GMT) X-Complaints-To: usenet@blaine.gmane.org NNTP-Posting-Date: Tue, 23 Oct 2018 23:08:14 +0000 (UTC) User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.1.50 (x86_64-unknown-cygwin) Cc: Kevin Ryde To: 33133@debbugs.gnu.org Original-X-From: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane.org@gnu.org Wed Oct 24 01:08:10 2018 Return-path: Envelope-to: geb-bug-gnu-emacs@m.gmane.org Original-Received: from lists.gnu.org ([208.118.235.17]) by blaine.gmane.org with esmtp (Exim 4.84_2) (envelope-from ) id 1gF5mT-0008TU-0A for geb-bug-gnu-emacs@m.gmane.org; Wed, 24 Oct 2018 01:08:09 +0200 Original-Received: from localhost ([::1]:44656 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1gF5oZ-00029i-CB for geb-bug-gnu-emacs@m.gmane.org; Tue, 23 Oct 2018 19:10:19 -0400 Original-Received: from eggs.gnu.org ([2001:4830:134:3::10]:34387) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1gF5oP-00027y-R8 for bug-gnu-emacs@gnu.org; Tue, 23 Oct 2018 19:10:11 -0400 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1gF5oK-0007tt-QM for bug-gnu-emacs@gnu.org; Tue, 23 Oct 2018 19:10:09 -0400 Original-Received: from debbugs.gnu.org ([208.118.235.43]:34642) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1gF5oK-0007tO-Ju for bug-gnu-emacs@gnu.org; Tue, 23 Oct 2018 19:10:04 -0400 Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1gF5oI-0007zd-Ic for bug-gnu-emacs@gnu.org; Tue, 23 Oct 2018 19:10:04 -0400 X-Loop: help-debbugs@gnu.org Resent-From: Katsumi Yamaoka Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Tue, 23 Oct 2018 23:10:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: report 33133 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: X-Debbugs-Original-To: bug-gnu-emacs@gnu.org Original-Received: via spool by submit@debbugs.gnu.org id=B.154033615030655 (code B ref -1); Tue, 23 Oct 2018 23:10:02 +0000 Original-Received: (at submit) by debbugs.gnu.org; 23 Oct 2018 23:09:10 +0000 Original-Received: from localhost ([127.0.0.1]:38900 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1gF5nR-0007yN-MY for submit@debbugs.gnu.org; Tue, 23 Oct 2018 19:09:09 -0400 Original-Received: from eggs.gnu.org ([208.118.235.92]:52424) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1gF5nO-0007xv-U6 for submit@debbugs.gnu.org; Tue, 23 Oct 2018 19:09:08 -0400 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1gF5nE-0006ja-HT for submit@debbugs.gnu.org; Tue, 23 Oct 2018 19:09:01 -0400 Original-Received: from lists.gnu.org ([2001:4830:134:3::11]:58596) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1gF5nE-0006is-1w for submit@debbugs.gnu.org; Tue, 23 Oct 2018 19:08:56 -0400 Original-Received: from eggs.gnu.org ([2001:4830:134:3::10]:33664) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1gF5nC-00023f-IN for bug-gnu-emacs@gnu.org; Tue, 23 Oct 2018 19:08:55 -0400 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1gF5n3-0006Vz-UR for bug-gnu-emacs@gnu.org; Tue, 23 Oct 2018 19:08:52 -0400 Original-Received: from coral.maple.relay.mailchannels.net ([23.83.214.39]:42673) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1gF5mx-0005e2-FS for bug-gnu-emacs@gnu.org; Tue, 23 Oct 2018 19:08:41 -0400 X-Sender-Id: tih5qno0ow|x-authuser|yamaoka@hampton.hostforweb.net Original-Received: from relay.mailchannels.net (localhost [127.0.0.1]) by relay.mailchannels.net (Postfix) with ESMTP id 24D99282822; Tue, 23 Oct 2018 23:07:56 +0000 (UTC) Original-Received: from hampton.hostforweb.net (unknown [100.96.19.78]) (Authenticated sender: tih5qno0ow) by relay.mailchannels.net (Postfix) with ESMTPA id 90CB9282C63; Tue, 23 Oct 2018 23:07:55 +0000 (UTC) X-Sender-Id: tih5qno0ow|x-authuser|yamaoka@hampton.hostforweb.net Original-Received: from hampton.hostforweb.net (hampton.hostforweb.net [172.245.115.217]) (using TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384) by 0.0.0.0:2500 (trex/5.16.2); Tue, 23 Oct 2018 23:07:56 +0000 X-MC-Relay: Neutral X-MailChannels-SenderId: tih5qno0ow|x-authuser|yamaoka@hampton.hostforweb.net X-MailChannels-Auth-Id: tih5qno0ow X-Vacuous-Abaft: 111069091fa92dfb_1540336075988_2192594722 X-MC-Loop-Signature: 1540336075987:3337611917 X-MC-Ingress-Time: 1540336075987 Original-Received: from s70.gtokyofl21.vectant.ne.jp ([202.215.75.70]:60000 helo=localhost) by hampton.hostforweb.net with esmtpsa (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256) (Exim 4.89_1) (envelope-from ) id 1gF5mC-009Pi0-41; Tue, 23 Oct 2018 18:07:53 -0500 Cancel-Lock: sha1:cQKpMnMykhq6rg+1wFwf2GKc/GU= X-OutGoing-Spam-Status: No, score=-0.2 X-AuthUser: yamaoka@hampton.hostforweb.net X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 208.118.235.43 X-BeenThere: bug-gnu-emacs@gnu.org List-Id: "Bug reports for GNU Emacs, the Swiss army knife of text editors" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane.org@gnu.org Original-Sender: "bug-gnu-emacs" Xref: news.gmane.org gmane.emacs.bugs:151535 Archived-At: --=-=-= Hi, Whereas `gzip -d' does, zlib-decompress-region doesn't decompress corrupted data of a certain kind. For instance, visiting https://www.gutenberg.org/no-such-page-exists using eww shows raw gzipped data. The data extracted is attached. As for `gzip -d', it says "unexpected end of file" in stderr. Here is a recipe to reproduce zlib-decompress-region not working: (let ((buffer (get-buffer-create "*testing*")) (coding-system-for-read 'binary) (cw (selected-window)) jka-compr-compression-info-list format-alist) (switch-to-buffer-other-window buffer) (erase-buffer) (set-buffer-multibyte nil) (insert-file-contents "/TEMP/corrupted-data.gz") (sit-for 1) (prog1 (zlib-decompress-region (point-min) (point-max)) (select-window cw))) If there is no prospect to improve zlib-decompress-region, how about this workaround? --- url-http.el~ 2018-09-12 07:48:16.110765500 +0000 +++ url-http.el 2018-10-23 23:04:48.060829900 +0000 @@ -951,7 +951,12 @@ (widen) (goto-char (point-min)) (when (search-forward "\n\n") - (zlib-decompress-region (point) (point-max))))))) + (or (zlib-decompress-region (point) (point-max)) + (let ((coding-system-for-write 'binary) + (coding-system-for-read 'binary) + (default-process-coding-system (cons 'binary 'binary))) + (zerop (call-process-region (point) (point-max) "gzip" + t '(t nil) nil "-d"))))))))) ;; Miscellaneous (defun url-http-activate-callback () In GNU Emacs 26.1.50 (build 1, x86_64-unknown-cygwin, GTK+ Version 3.22.28) of 2018-10-22 built on localhost Windowing system distributor 'The Cygwin/X Project', version 11.0.12001000 --=-=-= Content-Type: application/octet-stream Content-Disposition: attachment; filename=corrupted-data.gz Content-Transfer-Encoding: base64 H4sIAAAAAAAAA8xYW2/bNhR+rn/FCYelLVpbtpMNaWNraJO0C9CmQZqh6FNAS5TEmhI1krLrDfvv OyRlWbKdZEBfFqANRZ7Lx3NnJgfnn85uv15fwO+3Hz/A9R9vP1yeAekHwZejsyA4vz33B8eD4SgI Lq4IkMyY8nUQLJfLwfJoIFUa3N4EmcnFcaCN4pEZxCYmYa83sZsgaJFOCStwB2CSMRrbBS5zZihY YX32Z8UXU3ImC8MK079dlYxA5L+mxLDvxsk/hSijSjMzvfz8qX9y8sur/oi0hRU0Z1MyZ6ulVLEm sP3TiGQzKef6JbjfL6H+8h+JYuwlyELwAn/TKuZyj5KY6Ujx0nBZkHuUHB0Nh8MXTp5XpGupe8RF gmrNEx7RbYmNuLKaCR6Rx4z32awE22vCSGvrFcfuwYNBsimhZSlqzcE3uqD+sNYEwBN4ZmQJB1PQ TCTP4e/eGhxuD4T0rAPFSkEjBs+etiIkrRDBjKnUBsrT56cNKxVMGaS9VvIbiwy8XxMC10Dh3c3F BapTC44Sl9xkcPUJcpYjhc54CcpeW7F4AJcJrGQFJeUxaJmjpeMVMKEZooOUGciYQkfmdI47Gcsh 5QvmWPCfglwWbAUzGs0PNvD+8VYKvCVCqK2GzpujZjEl2lpZZ4wZUhuxMTFkiiVTYtdBmfaHw/HA WX5bQiaViSoDPPIOr9kSurA7A/xv7WvDjWDhNU0ZXEkD72RVxNCHHctNAk9p8yzwiWaX1iC1pJgv wIXalOSsqGZUNV52ZzyeEiFTSdZU7iNsnDahYOiMFzH7PiUj0uzbOG0xtPfray35nAcfKS/u7D06 FA70lLyX1mGWBBxJOOF52qZ7QAn+aBWhmpJHzuqWwpm+LNJtyiWPTYbwx6/QV4ynGSbIyXCbigrc RhABbSwUoInqBNq1ZdtKW0f9VMmqhM2yL8u6HrYMWzNkI9Ky8fGQAI0ipjVWtSkZk661MJ53w2Bj QwySNw3zmNzji7Ch95ed6JIWbfyalSScHqbmFDMCz0LoAG9FxKiDNtmD9krCmdQGpIJ3WBhjmf+G qbsFNWmgJp6GhHv4HkLb7z8GddyBKv6TYT9gMSqwsOwAFg1g4UlIWNP+GMijDsj5HpDvKx4z21Q0 JGgbW194ke4inDcIM7k0sm8JLUhPfoPFIv9BrMcdrOpxrJW2qikoOcOqtoNYNYgdQUDCG0fYxroG 4jPz4fz73+bbvkt0P9alOZYFNWy7OD/p+OHVCYHeE6/Z9mFdN+KSrkoqBpHMg+8RRuk8mFkHINip F/vz8bDTrA9pXp5yw/I7N6KcWyJs8y+MfFGb4EVjAl+s4d5+8GRTdn8db6ru0cgftWu3h5nyZF+P cCAYFHJpvbHrCZOhp9MMjbu6psILd4W8ZrztnoddB5ThrsQCa432k0JcW+AA2v2w7eOG7XUt6K7Z ubuygu6+oqC7tSkR3zq6cEzJpWLAi0QCnUmcC9bq9N6rIm/40XJcIoe9xiQoHw6eDMsni+/p7Jt8 2O6tm0iqA4nPOA6i0oZIm66+yd5xzquG2Qpq5p3mfo/yVmDUnH0vC3v7sevt7ZhbN/bRsBVi4w7J vV29tdwZleoxWndnpXWBkfaxM3GcGEEuD+qjREiK82H7EugsD3uN7xjTtcZtlx7f2pjC0sCsEjM/ JYa9cxxy7eg6dymQUYPl2ihZpCHuToJ6DRFW8IyJEmsslErGVbR+gvTQCbgjk77COmoL8LfKttWi 7moUYrr6refK3etNfLf8X6ZxOSiYLcjn3D74ZpV17rUVamXigN7E4yM1bV2CHVd7gMpGW+MuzrOj R+XYQde9O8vws1RqhS86zCNbs93VsOVYEzj7IWzEjInli70N0qrApw8XdCbYoOfQW0Ff0CSYZami cUWFWEFVxpiWtnEJAeytf9YJxG/dUcBPo+EAn30voUdxSMc679QrabXgI0QuLKt7hljlWF6WkHBh N/UKAzsfNJp7WCucIzdFxrsQDa8ZVVHmuih1l7IWH6A5ehZvKTGP+F/MnVv9vMDoWbCCsyJiSNa7 Rahz34UXXHN3n53MxccvXiHD1+EK6mA52K0ye/yQSGm6/uwkU7lSNq67/bhsfwF8YTNAXAwacji0 y1MYD4dH/fFwNNw7n6FeqlbwBq1jX3kudlwVhcM8pjo7hTfothsrUOMkYR+Y+IZsAwnKx1tys5wE /nE1cX+fCHv/AgAA//8= --=-=-=--