From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!not-for-mail From: Andy Wingo Newsgroups: gmane.lisp.guile.bugs,gmane.lisp.guile.devel Subject: bug#21093: Web server: response bodies systematically loaded in memory Date: Fri, 24 Jun 2016 10:15:40 +0200 Message-ID: <874m8jhuj7.fsf@pobox.com> References: <87a8uriysr.fsf@gnu.org> NNTP-Posting-Host: plane.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Trace: ger.gmane.org 1466756835 7409 80.91.229.3 (24 Jun 2016 08:27:15 GMT) X-Complaints-To: usenet@ger.gmane.org NNTP-Posting-Date: Fri, 24 Jun 2016 08:27:15 +0000 (UTC) Cc: 21093@debbugs.gnu.org, guile-devel@gnu.org To: ludo@gnu.org (Ludovic =?UTF-8?Q?Court=C3=A8s?=) Original-X-From: bug-guile-bounces+guile-bugs=m.gmane.org@gnu.org Fri Jun 24 10:27:03 2016 Return-path: Envelope-to: guile-bugs@m.gmane.org Original-Received: from lists.gnu.org ([208.118.235.17]) by plane.gmane.org with esmtp (Exim 4.69) (envelope-from ) id 1bGMS5-0007YG-OB for guile-bugs@m.gmane.org; Fri, 24 Jun 2016 10:27:01 +0200 Original-Received: from localhost ([::1]:41848 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1bGMS4-0002p7-3o for guile-bugs@m.gmane.org; Fri, 24 Jun 2016 04:27:00 -0400 Original-Received: from eggs.gnu.org ([2001:4830:134:3::10]:34988) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1bGMHU-0007HR-H8 for bug-guile@gnu.org; Fri, 24 Jun 2016 04:16:05 -0400 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1bGMHS-00024g-DL for bug-guile@gnu.org; Fri, 24 Jun 2016 04:16:03 -0400 Original-Received: from debbugs.gnu.org ([208.118.235.43]:40991) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1bGMHS-00024b-A9 for bug-guile@gnu.org; Fri, 24 Jun 2016 04:16:02 -0400 Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1bGMHS-0001Xn-6r for bug-guile@gnu.org; Fri, 24 Jun 2016 04:16:02 -0400 X-Loop: help-debbugs@gnu.org Resent-From: Andy Wingo Original-Sender: "Debbugs-submit" Resent-CC: bug-guile@gnu.org Resent-Date: Fri, 24 Jun 2016 08:16:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 21093 X-GNU-PR-Package: guile X-GNU-PR-Keywords: Original-Received: via spool by 21093-submit@debbugs.gnu.org id=B21093.14667561515915 (code B ref 21093); Fri, 24 Jun 2016 08:16:02 +0000 Original-Received: (at 21093) by debbugs.gnu.org; 24 Jun 2016 08:15:51 +0000 Original-Received: from localhost ([127.0.0.1]:53328 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1bGMHH-0001XL-DF for submit@debbugs.gnu.org; Fri, 24 Jun 2016 04:15:51 -0400 Original-Received: from pb-sasl1.pobox.com ([64.147.108.66]:59059 helo=sasl.smtp.pobox.com) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1bGMHG-0001XE-3c for 21093@debbugs.gnu.org; Fri, 24 Jun 2016 04:15:50 -0400 Original-Received: from sasl.smtp.pobox.com (unknown [127.0.0.1]) by pb-sasl1.pobox.com (Postfix) with ESMTP id ED05C18DBB; Fri, 24 Jun 2016 04:15:47 -0400 (EDT) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=pobox.com; h=from:to:cc :subject:references:date:in-reply-to:message-id:mime-version :content-type:content-transfer-encoding; s=sasl; bh=OhRI0wjEP7Uh fqQcVkPNJz/9Ymw=; b=sXVnMQUeSSMyuG5Hrd35RsYppxe2IXBFFlyVBmMALi/3 2a9zIluPm4o8mwKKkGiX25WiXEQDjtZ0RFMwUQfIXeYXNlCNY+2pM914vygmBPU4 ZbjxlElVggEQA5YewGp7ewnNA4TsLfrA0iRrC0bwP2U+Ngb97FOx1fCL1L08J4o= DomainKey-Signature: a=rsa-sha1; c=nofws; d=pobox.com; h=from:to:cc :subject:references:date:in-reply-to:message-id:mime-version :content-type:content-transfer-encoding; q=dns; s=sasl; b=uKIVGt Dq0mwrsw1k+AlGBjL/m195lQQl53DwKybyQsWUKYy1O27l3w4cJPQFONA6WIZiZa AvySmFNlchQsk1XsDjQ/Y6ocwolfa0oi0gPpUWcAuz6Ua3CwJXFRdTFXRhZp6OJx jQgfzDSDPRyUmbJc2zXtF9OMNRlmgKQS3gwQE= Original-Received: from pb-sasl1.nyi.icgroup.com (unknown [127.0.0.1]) by pb-sasl1.pobox.com (Postfix) with ESMTP id D6C8618DB8; Fri, 24 Jun 2016 04:15:47 -0400 (EDT) Original-Received: from clucks (unknown [88.160.190.192]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by pb-sasl1.pobox.com (Postfix) with ESMTPSA id 22F5A18DB7; Fri, 24 Jun 2016 04:15:47 -0400 (EDT) In-Reply-To: <87a8uriysr.fsf@gnu.org> ("Ludovic =?UTF-8?Q?Court=C3=A8s?="'s message of "Mon, 20 Jul 2015 00:10:28 +0200") User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.5 (gnu/linux) X-Pobox-Relay-ID: DACDDC84-39E3-11E6-A882-C1836462E9F6-02397024!pb-sasl1.pobox.com X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 208.118.235.43 X-BeenThere: bug-guile@gnu.org List-Id: "Bug reports for GUILE, GNU's Ubiquitous Extension Language" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-guile-bounces+guile-bugs=m.gmane.org@gnu.org Original-Sender: "bug-guile" Xref: news.gmane.org gmane.lisp.guile.bugs:8207 gmane.lisp.guile.devel:18408 Archived-At: On Mon 20 Jul 2015 00:10, ludo@gnu.org (Ludovic Court=C3=A8s) writes: > The =E2=80=98sanitize-response=E2=80=99 procedure systematically loads th= e whole > response body in memory, which causes obvious scalability issues (this > is in 2.0.11.) > > In particular, when a request handler returns a port-taking procedure as > its second return value, =E2=80=98sanitize-request=E2=80=99 will just cal= l that > procedure passing it a string output port. > > This procedure should instead be called from the server implementation=E2= =80=99s > =E2=80=98write=E2=80=99 hook, but that would necessitate an API change. > > Thoughts? How would you set the Content-Length? Just leave it off and set Connection: close ? Set it in the headers perhaps? Then you have to verify later, which I dunno how nice that is. Maybe it is OK. I would be happy to review patches :) Cc guile-devel. Andy