From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!not-for-mail From: Giorgos Keramidas Newsgroups: gmane.emacs.help Subject: Re: Reading huge files Date: Thu, 11 Jan 2007 00:33:51 +0200 Organization: SunSITE.dk - Supporting Open source Message-ID: <87fyaia4vk.fsf@kobe.laptop> References: <8642ba650701081417n3c658d33v6dbf743a9bd30c7c@mail.gmail.com> NNTP-Posting-Host: lo.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Trace: sea.gmane.org 1168468895 20501 80.91.229.12 (10 Jan 2007 22:41:35 GMT) X-Complaints-To: usenet@sea.gmane.org NNTP-Posting-Date: Wed, 10 Jan 2007 22:41:35 +0000 (UTC) Original-X-From: help-gnu-emacs-bounces+geh-help-gnu-emacs=m.gmane.org@gnu.org Wed Jan 10 23:41:33 2007 Return-path: Envelope-to: geh-help-gnu-emacs@m.gmane.org Original-Received: from lists.gnu.org ([199.232.76.165]) by lo.gmane.org with esmtp (Exim 4.50) id 1H4m8G-0007bN-Ob for geh-help-gnu-emacs@m.gmane.org; Wed, 10 Jan 2007 23:41:21 +0100 Original-Received: from localhost ([127.0.0.1] helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.43) id 1H4m8G-0003eU-DC for geh-help-gnu-emacs@m.gmane.org; Wed, 10 Jan 2007 17:41:20 -0500 Original-Path: shelby.stanford.edu!newsfeed.stanford.edu!postnews.google.com!news4.google.com!news.glorb.com!dotsrc.org!filter.dotsrc.org!news.dotsrc.org!not-for-mail Original-Newsgroups: gnu.emacs.help User-Agent: Gnus/5.11 (Gnus v5.11) Emacs/22.0.92 (berkeley-unix) Cancel-Lock: sha1:BbO0nZrpiw4sm8gtW3/ww2BghhE= Original-Lines: 33 Original-NNTP-Posting-Host: 62.103.39.229 Original-X-Trace: news.sunsite.dk DXC=KC; _CjGY]oDc5QH[6O^X]LYSB=nbEKnkKh64k[3Cc7mAL^MjG2:ak; I7eU]GGb30c[>DY7K:h?>73Ng; LK Original-X-Complaints-To: staff@sunsite.dk Original-Xref: shelby.stanford.edu gnu.emacs.help:144616 Original-To: help-gnu-emacs@gnu.org X-BeenThere: help-gnu-emacs@gnu.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Users list for the GNU Emacs text editor List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Original-Sender: help-gnu-emacs-bounces+geh-help-gnu-emacs=m.gmane.org@gnu.org Errors-To: help-gnu-emacs-bounces+geh-help-gnu-emacs=m.gmane.org@gnu.org Xref: news.gmane.org gmane.emacs.help:40220 Archived-At: On Wed, 10 Jan 2007 22:27:57 +0200, Eli Zaretskii wrote: >> From: Mathias Dahl >> Date: Wed, 10 Jan 2007 08:39:16 +0100 >> >> Eli Zaretskii writes: >> >> > If this is a 32-bit machine, then the Lisp integer overflows at >> > 256MB. If that's a 64-bit machine, then you don't need any tricks >> > to edit 700MB files. >> >> Okay. Then I probably never scrolled that far when I tested :) > > If you never scrolled past 256MB, then you indeed wouldn't notice. > >> I guess >> the head + tail trick would work though, I suspect those tools does >> not have this limitation. > > Yes, that should work. FWIW, I've also uses split(1) with great success, when I had to process *huge* log files and tcpdump output, ranging from 500 MB to almost 1 GB of text. Handling multi-hundred-megabyte files works fine, for instance, with something like: freebsd % split -b 50m huge-file or with: linux % split -b 50000000 huge-file