23.0.50; Possible bug with bzip2 compressed tar files?

23.0.50; Possible bug with bzip2 compressed tar files?

[Peter Dyballa]

Hello!

There seems to be a problem with bzip2 compressed tar files. It does  
not happen with every such file. It does not depend from the file  
size, or the block size used by bzip, nor the file name  
extension, .tar.bz2 or .tbz2 or .tbz. One stable element is that the  
files all come from one source: The Omni Group! I can't be more  
specific, because the files are fetched by the web browser OmniWeb  
from some site and saved locally inside a UNIX file system. The saved  
archives are almost 15 MB in size – which I probably can't send by  
eMail, FTP would be an option. I'll also contact the Omni Group.

Using tar (versions 1.14 +CVE-2006-0300 +CVE-2006-6097 or 1.16.1,  
bzip2 Version 1.0.4, 20-Dec-2006) on the command line, I can list the  
archive's contents and also extract files:

	tar: Record size = 8 blocks
	drwxr-xr-x root/admin        0 2008-01-10 22:51:47 OmniWeb.app/
	drwxr-xr-x root/admin        0 2008-01-10 22:52:24 OmniWeb.app/ 
Contents/
	drwxr-xr-x root/admin        0 2008-01-10 22:52:24 OmniWeb.app/ 
Contents/Frameworks/
	drwxr-xr-x root/admin        0 2008-01-10 22:52:33 OmniWeb.app/ 
Contents/Frameworks/JavaScriptCore.framework/
	lrwxrwxr-x root/wheel        0 2008-01-10 22:51:59 OmniWeb.app/ 
Contents/Frameworks/JavaScriptCore.framework/JavaScriptCore ->  
Versions/Current/JavaScriptCore
	lrwxrwxr-x root/wheel        0 2008-01-10 22:51:59 OmniWeb.app/ 
Contents/Frameworks/JavaScriptCore.framework/Resources -> Versions/ 
Current/Resources

The error happens also in GNU Emacs 23.0.60 and in GNU Emacs 22.1.50.


In GNU Emacs 23.0.50.1 (powerpc-apple-darwin8.11.0, X toolkit, Xaw3d  
scroll bars)
  of 2008-01-12 on Latsche.local
Windowing system distributor `The XFree86 Project, Inc', version  
11.0.40400000
configured using `configure  '--with-dbus' '--without-sound' '-- 
without-pop' '--with-xpm' '--with-jpeg' '--with-tiff' '--with-gif' '-- 
with-png' '--with-x-toolkit=athena' '--enable-locallisppath=/Library/ 
Application Support/Emacs/calendar22:/Library/Application Support/ 
Emacs/caml:/Library/Application Support/Emacs:/sw/share/emacs21/site- 
lisp/elib' 'PKG_CONFIG_PATH=/sw/lib/freetype219/lib/pkgconfig:/sw/lib/ 
fontconfig2/lib/pkgconfig:/usr/X11R6/lib/pkgconfig:/sw/lib/pkgconfig:/ 
sw/lib/system-openssl/lib/pkgconfig:/sw/share/pkgconfig:/usr/lib/ 
pkgconfig:/usr/local/lib/pkgconfig:/usr/local/clamXav/lib/pkgconfig'  
'CFLAGS=-Wno-pointer-sign -bind_at_load -pipe -fPIC -mcpu=7450 - 
mtune=7450 -fast -mpim-altivec -ftree-vectorize -foptimize-register- 
move -freorder-blocks -freorder-blocks-and-partition -fthread-jumps - 
fpeephole -fno-crossjumping' 'CPPFLAGS=-no-cpp-precomp -I/usr/include/ 
openssl -I/sw/include/pango-1.0 -I/sw/lib/freetype219/include -I/sw/ 
lib/freetype219/include/freetype2 -I/sw/lib/fontconfig2/include -I/sw/ 
include -I/usr/local/include -idirafter /usr/X11R6/include' 'LDFLAGS=- 
dead_strip -multiply_defined suppress -L/sw/lib/ncurses -L/sw/lib/ 
freetype219/lib -L/sw/lib/fontconfig2/lib -L/sw/lib -L/usr/local/lib - 
L/usr/X11R6/lib''

Important settings:
   value of $LC_ALL: nil
   value of $LC_COLLATE: nil
   value of $LC_CTYPE: de_DE.UTF-8
   value of $LC_MESSAGES: nil
   value of $LC_MONETARY: nil
   value of $LC_NUMERIC: nil
   value of $LC_TIME: nil
   value of $LANG: de_DE.UTF-8
   locale-coding-system: utf-8
   default-enable-multibyte-characters: t

Major mode: Fundamental

Minor modes in effect:
   show-paren-mode: t
   display-time-mode: t
   tooltip-mode: t
   tool-bar-mode: t
   mouse-wheel-mode: t
   file-name-shadow-mode: t
   global-font-lock-mode: t
   font-lock-mode: t
   blink-cursor-mode: t
   unify-8859-on-encoding-mode: t
   utf-translate-cjk-mode: t
   auto-compression-mode: t
   column-number-mode: t
   line-number-mode: t
   transient-mark-mode: t
   view-mode: t

Recent input:
<down-mouse-1> <mouse-1> C-x d / V o <tab> H a <tab>
_ n e <tab> <return> <escape> < s <down> <down> <down>
<down> <down> <down> <down> v y <help-echo> <help-echo>
<help-echo> <help-echo> <help-echo> <help-echo> <menu-bar>
<help-menu> <send-emacs-bug-report>

Recent messages:
For information about GNU Emacs and the GNU system, type C-h C-a.
Loading time...done
Loading paren...done
Mark set
File OmniWeb-5.7-r97021-Alpha.tbz2 is large (14MB), really open? (y  
or n)
View mode: type C-h for help, h for commands, q to quit.

Not using View mode because the major mode is special



--
Greetings

   Pete

I love deadlines. I love the whooshing noise they make as they go by.
				– Douglas Adams

Re: 23.0.50; Possible bug with bzip2 compressed tar files?

[Andreas Schwab]

Peter Dyballa <Peter_Dyballa@Freenet.DE> writes:

> There seems to be a problem with bzip2 compressed tar files.

I could not find a description of the problem in your report.

Andreas.

-- 
Andreas Schwab, SuSE Labs, schwab@suse.de
SuSE Linux Products GmbH, Maxfeldstraße 5, 90409 Nürnberg, Germany
PGP key fingerprint = 58CA 54C7 6D53 942B 1756  01D3 44D5 214B 8276 4ED5
"And now for something completely different."

Re: 23.0.50; Possible bug with bzip2 compressed tar files?

[Peter Dyballa]

Am 12.01.2008 um 15:25 schrieb Andreas Schwab:

>> There seems to be a problem with bzip2 compressed tar files.
>
> I could not find a description of the problem in your report.


I do not see the archive's structure/elements, I get only a  
presentation of binary characters starting with BZh. On the command  
line all members are listed, though ...

--
Mit friedvollen Grüßen

   Pete

Wasting time is an important part of living.

Re: 23.0.50; Possible bug with bzip2 compressed tar files?

[Eli Zaretskii]

> From: Peter Dyballa <Peter_Dyballa@Freenet.DE>
> Date: Sat, 12 Jan 2008 16:14:43 +0100
> Cc: emacs-pretest-bug@gnu.org
> 
> Am 12.01.2008 um 15:25 schrieb Andreas Schwab:
> 
> >> There seems to be a problem with bzip2 compressed tar files.
> >
> > I could not find a description of the problem in your report.
> 
> 
> I do not see the archive's structure/elements, I get only a  
> presentation of binary characters starting with BZh.

Anything interesting in *Messages*?

Also, what happens if you set debug-on-error non-nil?

Re: 23.0.50; Possible bug with bzip2 compressed tar files?

[Peter Dyballa]

Am 12.01.2008 um 16:56 schrieb Eli Zaretskii:

>> I do not see the archive's structure/elements, I get only a
>> presentation of binary characters starting with BZh.
>
> Anything interesting in *Messages*?

	For information about GNU Emacs and the GNU system, type C-h C-a.
	Mark set
	Mark saved where search started
	File OmniWeb-5.7-r97021-Alpha.tbz2 is large (14MB), really open? (y  
or n)
	View mode: type C-h for help, h for commands, q to quit.

is all.

>
> Also, what happens if you set debug-on-error non-nil?


Nothing more. There does not seem to be a real error from this file:

   -rw-r--r--     1 pete  pete   15234352 10 Jan 22:59 OmniWeb-5.7- 
r97021-Alpha.tbz2


--
Greetings

   Pete     === -Q
              ==<__/% >>
_____________(_)____@_____________________________

Re: 23.0.50; Possible bug with bzip2 compressed tar files?

[Eli Zaretskii]

> From: Peter Dyballa <Peter_Dyballa@Freenet.DE>
> Date: Sat, 12 Jan 2008 17:03:11 +0100
> Cc: schwab@suse.de, emacs-pretest-bug@gnu.org
> 
> 
> Am 12.01.2008 um 16:56 schrieb Eli Zaretskii:
> 
> >> I do not see the archive's structure/elements, I get only a
> >> presentation of binary characters starting with BZh.
> >
> > Anything interesting in *Messages*?
> 
> 	For information about GNU Emacs and the GNU system, type C-h C-a.
> 	Mark set
> 	Mark saved where search started
> 	File OmniWeb-5.7-r97021-Alpha.tbz2 is large (14MB), really open? (y  
> or n)
> 	View mode: type C-h for help, h for commands, q to quit.
> 
> is all.
> 
> >
> > Also, what happens if you set debug-on-error non-nil?
> 
> 
> Nothing more. There does not seem to be a real error from this file:
> 
>    -rw-r--r--     1 pete  pete   15234352 10 Jan 22:59 OmniWeb-5.7- 
> r97021-Alpha.tbz2

.tbz2?  I don't think Emacs automatically tries to un-bzip2 and untar
that, does it?  Does it help to tweak jka-compr-compression-info-list?

Re: 23.0.50; Possible bug with bzip2 compressed tar files?

[Peter Dyballa]

Am 12.01.2008 um 17:23 schrieb Eli Zaretskii:

>>    -rw-r--r--     1 pete  pete   15234352 10 Jan 22:59 OmniWeb-5.7-
>> r97021-Alpha.tbz2
>
> .tbz2?  I don't think Emacs automatically tries to un-bzip2 and untar
> that, does it?  Does it help to tweak jka-compr-compression-info-list?


Yes, of course: this extension is missing! It only has, tar and bzip2  
related:

	["\\.tbz\\'" "bzip2ing" "bzip2" nil "bunzip2ing" "bzip2"
	  ("-d")
	  nil nil "BZh"]

Since it's much easier to create a hard link OmniWeb-5.7-r97021- 
Alpha.tbz I first did that. And now I get an error:

	Debugger entered--Lisp error: (error "{
	    IBClasses = (
	        {
	            ACTIONS = {replace = id; replaceAll = id;  
replaceAndFind  has size -48678843 - corrupted")
	  signal(error ("{\n    IBClasses = (\n        {\n             
ACTIONS = {replace = id; replaceAll = id; replaceAndFind  has size  
-48678843 - corrupted"))
	  error("%s has size %s - corrupted" "{\n    IBClasses = (\n         
{\n            ACTIONS = {replace = id; replaceAll = id;  
replaceAndFind " -48678843)
	  tar-summarize-buffer()
	  tar-mode()
	  set-auto-mode-0(tar-mode nil)
	  set-auto-mode()
	  normal-mode(t)
	  after-find-file(nil t)
	  find-file-noselect-1(#<buffer OmniWeb-5.7-r97021-Alpha.tbz> "/ 
Volumes/drau\x8df\ en/weich/OmniWeb-5.7-r97021-Alpha.tbz" nil nil "/ 
Volumes/drau\x8df\ en/weich/OmniWeb-5.7-r97021-Alpha.tbz" (4696  
234881037))
	  find-file-noselect("/Volumes/drau\x8df\ en/weich/OmniWeb-5.7- 
r97021-Alpha.tbz")
	  view-file("/Volumes/drau\x8df\ en/weich/OmniWeb-5.7-r97021- 
Alpha.tbz")
	  dired-view-file()
	  call-interactively(dired-view-file nil nil)

It works to view other bzip2 or gzip compressed TAR files on that  
external disk in the same directory. *Messages* contains:

	File OmniWeb-5.7-r97021-Alpha.tbz is large (14MB), really open? (y  
or n)
	bunzip2ing OmniWeb-5.7-r97021-Alpha.tbz...done
	Parsing tar file...
	Entering debugger...


So I made my test case, adding

	(add-to-list 'auto-mode-alist '("\\.tbz2\\'" . tar-mode))

and adjusting the original \.tbz\' value to \.tbz\(\|2\)\':

	'(jka-compr-compression-info-list (quote (["\\.Z\\(~\\|\\.~[0-9]+~\ 
\)?\\'" "compressing" "compress" ("-c") "uncompressing" "gzip" ("-c"  
"-q" "-d") nil t "\x1f\x9d"] ["\\.bz2\\(~\\|\\.~[0-9]+~\\)?\\'"  
"bzip2ing" "bzip2" nil "bunzip2ing" "bzip2" ("-d") nil t "BZh"] ["\ 
\.tbz\\(\\|2\\)\\'" "bzip2ing" "bzip2" nil "bunzip2ing" "bzip2" ("- 
d") nil nil "BZh"] ["\\.\\(?:tgz\\|svgz\\)\\'" "compressing"  
"gzip" ("-c" "-q") "uncompressing" "gzip" ("-c" "-q" "-d") t nil  
"\x1f\x8b"] ["\\.g?z\\(~\\|\\.~[0-9]+~\\)?\\'" "compressing" "gzip" ("- 
c" "-q") "uncompressing" "gzip" ("-c" "-q" "-d") t t "\x1f\x8b"] ["\\.dz\ 
\'" nil nil nil "uncompressing" "gzip" ("-c" "-q" "-d") nil t  
"\x1f\x8b"])))

So I have the test files

   -rw-r--r--   3 pete pete   15M 10. Jan 22:59 OmniWeb-5.7-r97021- 
Alpha.tar.bz2
   -rw-r--r--   3 pete pete   15M 10. Jan 22:59 OmniWeb-5.7-r97021- 
Alpha.tbz
• -rw-r--r--   3 pete pete   15M 10. Jan 22:59 OmniWeb-5.7-r97021- 
Alpha.tbz2

and

• -rw-r--r--   3 pete pete  306K 16. Sep 2006  MesaGLUT-6.5.1.tar.bz2
   -rw-r--r--   3 pete pete  306K 16. Sep 2006  MesaGLUT-6.5.1.tbz
   -rw-r--r--   3 pete pete  306K 16. Sep 2006  MesaGLUT-6.5.1.tbz2

the original file marked with •. I have no problem viewing the  
MesaGLUT-6.5.1 archive from dired, but the OmniWeb-5.7 files produce  
an error, the same as mentioned above:

	Debugger entered--Lisp error: (error "{
	    IBClasses = (
	        {
	            ACTIONS = {replace = id; replaceAll = id;  
replaceAndFind  has size -48678843 - corrupted")
	  signal(error ("{\n    IBClasses = (\n        {\n             
ACTIONS = {replace = id; replaceAll = id; replaceAndFind  has size  
-48678843 - corrupted"))
	  error("%s has size %s - corrupted" "{\n    IBClasses = (\n         
{\n            ACTIONS = {replace = id; replaceAll = id;  
replaceAndFind " -48678843)
	  tar-summarize-buffer()
	  tar-mode()
	  set-auto-mode-0(tar-mode nil)
	  set-auto-mode()
	  normal-mode(t)
	  after-find-file(nil t)
	  find-file-noselect-1(#<buffer OmniWeb-5.7-r97021-Alpha.tar.bz2> "/ 
Volumes/drau\x8df\ en/weich/OmniWeb-5.7-r97021-Alpha.tar.bz2" nil nil  
"/Volumes/drau\x8df\ en/weich/OmniWeb-5.7-r97021-Alpha.tar.bz2" (4696  
234881037))
	  find-file-noselect("/Volumes/drau\x8df\ en/weich/OmniWeb-5.7- 
r97021-Alpha.tar.bz2")
	  view-file("/Volumes/drau\x8df\ en/weich/OmniWeb-5.7-r97021- 
Alpha.tar.bz2")
	  dired-view-file()
	  call-interactively(dired-view-file nil nil)

The OmniWeb... buffer starts with

	OmniWeb.app/^@^@^@

*Messages* contains:

	bunzip2ing MesaGLUT-6.5.1.tar.bz2...done
	Parsing tar file...done
	Not using View mode because the major mode is special
	bunzip2ing MesaGLUT-6.5.1.tbz...done
	Parsing tar file...done
	Not using View mode because the major mode is special
	bunzip2ing MesaGLUT-6.5.1.tbz2...done
	Parsing tar file...done
	Not using View mode because the major mode is special
	Mark saved where search started
	File OmniWeb-5.7-r97021-Alpha.tar.bz2 is large (14MB), really open?  
(y or n)
	bunzip2ing OmniWeb-5.7-r97021-Alpha.tar.bz2...done
	Parsing tar file...
	Entering debugger...

So it's one of the rare times when size does matter? On disk the  
archive is almost 48 MB with almost 4,000 files and directories.

The other hard links produce in *Messages*

	File OmniWeb-5.7-r97021-Alpha.tbz is large (14MB), really open? (y  
or n)
	bunzip2ing OmniWeb-5.7-r97021-Alpha.tbz...done
	Parsing tar file...
	File mode specification error: (error "{
	    IBClasses = (
	        {
	            ACTIONS = {replace = id; replaceAll = id;  
replaceAndFind  has size -48678843 - corrupted")
	Not using View mode because the major mode is special
	File OmniWeb-5.7-r97021-Alpha.tbz2 is large (14MB), really open? (y  
or n)
	bunzip2ing OmniWeb-5.7-r97021-Alpha.tbz2...done
	Parsing tar file...
	File mode specification error: (error "{
	    IBClasses = (
	        {
	            ACTIONS = {replace = id; replaceAll = id;  
replaceAndFind  has size -48678843 - corrupted")
	Not using View mode because the major mode is special
	Mark set

The OmniWeb... buffers start each time also with

	OmniWeb.app/^@^@^@

Opening the hard-linked OmniWeb archive in other sequence (.tbz  
or .tbz2 first) brings the same "success" ...

--
Greetings

   Pete

The human animal differs from the lesser primates in his passion for  
lists of "Ten Best."
				– H. Allen Smith

Re: 23.0.50; Possible bug with bzip2 compressed tar files?

[Peter Dyballa]

Hello!

Here is an answer I received from OmniWeb:

	The .tbz2 files are enclosures in the appcast feed here:
	
	http://update.omnigroup.com/appcast/? 
title=OmniWeb&release_track=sneakypeek
	
	for example, here's the most recent as of this writing:
	
	http://www.omnigroup.com/ftp1/pub/sneakypeek/omniweb/releases/ 
OmniWeb-5.7-r97062-Alpha.tbz2

The latter is the file I also used.

--
Greetings

   Pete

One person with a belief is a social power equal to ninety-nine who  
have only interests.
				– John Stuart Mill