r6rs-ports.test is failing

r6rs-ports.test is failing

[dsmich]

The r6rs-ports.test is failing for me on a Debian Lenny 64bit system.

$ git describe
release_1-9-13-107-ga0ad8ad

$ ./check-guile r6rs-ports.test
Testing /home/dsmith/src/guile/meta/guile ... r6rs-ports.test
with GUILE_LOAD_PATH=/home/dsmith/src/guile/test-suite
Running r6rs-ports.test
UNRESOLVED: r6rs-ports.test: 7.2.11 Binary Output: put-bytevector [2 args]
UNRESOLVED: r6rs-ports.test: 7.2.11 Binary Output: put-bytevector [3 args]
UNRESOLVED: r6rs-ports.test: 7.2.11 Binary Output: put-bytevector [4 args]
ERROR: r6rs-ports.test: 8.2.6  Input and output ports: transcoded-port [error handling mode = replace] - arguments: ((encoding-error "scm_from_stringn" "input locale conversion error" 84 "UTF-8" "UTF-32" #vu8(255 1 2 3 103 110 117)))

Totals for this test run:
passes:                 36
failures:               0
unexpected passes:      0
expected failures:      0
unresolved test cases:  3
untested test cases:    0
unsupported test cases: 0
errors:                 1


$ env | grep -E '(LANG|LC)'
LANG=en_US.UTF-8
GDM_LANG=en_US.UTF-8


$ locale
LANG=en_US.UTF-8
LC_CTYPE="en_US.UTF-8"
LC_NUMERIC="en_US.UTF-8"
LC_TIME="en_US.UTF-8"
LC_COLLATE="en_US.UTF-8"
LC_MONETARY="en_US.UTF-8"
LC_MESSAGES="en_US.UTF-8"
LC_PAPER="en_US.UTF-8"
LC_NAME="en_US.UTF-8"
LC_ADDRESS="en_US.UTF-8"
LC_TELEPHONE="en_US.UTF-8"
LC_MEASUREMENT="en_US.UTF-8"
LC_IDENTIFICATION="en_US.UTF-8"
LC_ALL=

Re: r6rs-ports.test is failing

[dsmich]

---- dsmich@roadrunner.com wrote: 
> The r6rs-ports.test is failing for me on a Debian Lenny 64bit system.


FWIW, here is the output from git bisect:

d4b8163784c4764b5b5ecd3c5ac3892cc5b46e64 is first bad commit
commit d4b8163784c4764b5b5ecd3c5ac3892cc5b46e64
Author: Ludovic Courtès <ludo@gnu.org>
Date:   Wed Nov 24 23:01:50 2010 +0100

    Honor R6RS transcoder error handling modes, when possible.
    
    * module/rnrs/io/ports.scm (transcoded-port): Change RESULT's conversion
      strategy based on TRANSCODER's error-handling mode.
    
    * test-suite/tests/r6rs-ports.test ("8.2.6  Input and output
      ports")["transcoded-port [error handling mode = raise]",
      "transcoded-port [error handling mode = replace]"]: New tests.

:040000 040000 39e0776dc561c08c478b976beb094f4b9bc2c7ac f53be35c60c4c15d433381dd6f8416ca24953900 M      module
:040000 040000 b5c9c558cc161ff4f1316d1958aef15c484ac00f 0b263bdf54763231064c485172555b1fb22edf31 M      test-suite
bisect run success

Re: r6rs-ports.test is failing

[Ludovic Courtès]

Hi!

Sorry for the late reply.

<dsmich@roadrunner.com> writes:

> $ git describe
> release_1-9-13-107-ga0ad8ad
>
> $ ./check-guile r6rs-ports.test
> Testing /home/dsmith/src/guile/meta/guile ... r6rs-ports.test
> with GUILE_LOAD_PATH=/home/dsmith/src/guile/test-suite
> Running r6rs-ports.test
> UNRESOLVED: r6rs-ports.test: 7.2.11 Binary Output: put-bytevector [2 args]
> UNRESOLVED: r6rs-ports.test: 7.2.11 Binary Output: put-bytevector [3 args]
> UNRESOLVED: r6rs-ports.test: 7.2.11 Binary Output: put-bytevector [4 args]
> ERROR: r6rs-ports.test: 8.2.6  Input and output ports: transcoded-port [error handling mode = replace] - arguments: ((encoding-error "scm_from_stringn" "input locale conversion error" 84 "UTF-8" "UTF-32" #vu8(255 1 2 3 103 110 117)))

Can you try this?

  (define p (open-bytevector-input-port #vu8(255 1 2 3 103 110 117)))
  (set-port-conversion-strategy! p 'substitute)
  (get-line p)

Here on x86_64-linux-gnu, with libunistring 0.9.3, it returns a
7-character string ending in “gnu”.

Thanks,
Ludo’.

Re: r6rs-ports.test is failing

[dsmich]

---- "Ludovic Courtès" <ludo@gnu.org> wrote: 
> Hi!
> 
> Sorry for the late reply.

No problem!

> Can you try this?
> 
>   (define p (open-bytevector-input-port #vu8(255 1 2 3 103 110 117)))
>   (set-port-conversion-strategy! p 'substitute)
>   (get-line p)
> 
> Here on x86_64-linux-gnu, with libunistring 0.9.3, it returns a
> 7-character string ending in “gnu”.

scheme@(guile-user)> (use-modules (rnrs))
scheme@(guile-user)> (define p (open-bytevector-input-port #vu8(255 1 2 3 103 110 117)))
scheme@(guile-user)> (set-port-conversion-strategy! p 'substitute)
scheme@(guile-user)> (get-line p)
$1 = "�\x01\x02\x03gnu"
scheme@(guile-user)> (version)
$2 = "1.9.13.176-3df53"


That does look like a 7 char string ending in gnu.

-Dale

Re: r6rs-ports.test is failing

[Ludovic Courtès]

Hi!

<dsmich@roadrunner.com> writes:

> ---- "Ludovic Courtès" <ludo@gnu.org> wrote: 

[...]

>>   (define p (open-bytevector-input-port #vu8(255 1 2 3 103 110 117)))
>>   (set-port-conversion-strategy! p 'substitute)
>>   (get-line p)
>> 
>> Here on x86_64-linux-gnu, with libunistring 0.9.3, it returns a
>> 7-character string ending in “gnu”.
>
> scheme@(guile-user)> (use-modules (rnrs))
> scheme@(guile-user)> (define p (open-bytevector-input-port #vu8(255 1 2 3 103 110 117)))
> scheme@(guile-user)> (set-port-conversion-strategy! p 'substitute)
> scheme@(guile-user)> (get-line p)
> $1 = "�\x01\x02\x03gnu"

And this?

    (let* ((t  (make-transcoder (utf-8-codec) (native-eol-style)
                                (error-handling-mode replace)))
           (b  (open-bytevector-input-port #vu8(255 1 2 3 103 110 117)))
           (tp (transcoded-port b t)))
      (port-conversion-strategy tp))

Ludo’.

Re: r6rs-ports.test is failing

[dsmich]

---- "Ludovic Courtès" <ludo@gnu.org> wrote: 
> And this?
> 
>     (let* ((t  (make-transcoder (utf-8-codec) (native-eol-style)
>                                 (error-handling-mode replace)))
>            (b  (open-bytevector-input-port #vu8(255 1 2 3 103 110 117)))
>            (tp (transcoded-port b t)))
>       (port-conversion-strategy tp))


$2 = substitute


-Dale

Re: r6rs-ports.test is failing

[Andy Wingo]

On Wed 01 Dec 2010 23:28, <dsmich@roadrunner.com> writes:

> The r6rs-ports.test is failing for me on a Debian Lenny 64bit system.
>
> $ git describe
> release_1-9-13-107-ga0ad8ad
>
> $ ./check-guile r6rs-ports.test
> Testing /home/dsmith/src/guile/meta/guile ... r6rs-ports.test
> with GUILE_LOAD_PATH=/home/dsmith/src/guile/test-suite
> Running r6rs-ports.test
> UNRESOLVED: r6rs-ports.test: 7.2.11 Binary Output: put-bytevector [2 args]
> UNRESOLVED: r6rs-ports.test: 7.2.11 Binary Output: put-bytevector [3 args]
> UNRESOLVED: r6rs-ports.test: 7.2.11 Binary Output: put-bytevector [4 args]
> ERROR: r6rs-ports.test: 8.2.6  Input and output ports: transcoded-port [error handling mode = replace] - arguments: ((encoding-error "scm_from_stringn" "input locale conversion error" 84 "UTF-8" "UTF-32" #vu8(255 1 2 3 103 110 117)))

I gather that this is still an issue, but that this code is being
rewritten; can you please ping us if this bug is still present next
weekend?

Thanks!

Andy
-- 
http://wingolog.org/

Re: r6rs-ports.test is failing

[dsmich]

---- Andy Wingo <wingo@pobox.com> wrote: 
> On Wed 01 Dec 2010 23:28, <dsmich@roadrunner.com> writes:
> 
> > The r6rs-ports.test is failing for me on a Debian Lenny 64bit system.
> >
> > $ git describe
> > release_1-9-13-107-ga0ad8ad
> >
> > $ ./check-guile r6rs-ports.test
> > Testing /home/dsmith/src/guile/meta/guile ... r6rs-ports.test
> > with GUILE_LOAD_PATH=/home/dsmith/src/guile/test-suite
> > Running r6rs-ports.test
> > UNRESOLVED: r6rs-ports.test: 7.2.11 Binary Output: put-bytevector [2 args]
> > UNRESOLVED: r6rs-ports.test: 7.2.11 Binary Output: put-bytevector [3 args]
> > UNRESOLVED: r6rs-ports.test: 7.2.11 Binary Output: put-bytevector [4 args]
> > ERROR: r6rs-ports.test: 8.2.6  Input and output ports: transcoded-port [error handling mode = replace] - arguments: ((encoding-error "scm_from_stringn" "input locale conversion error" 84 "UTF-8" "UTF-32" #vu8(255 1 2 3 103 110 117)))
> 
> I gather that this is still an issue, but that this code is being
> rewritten; can you please ping us if this bug is still present next
> weekend?

Yes, it's still an issue as of release_1-9-14-85-gbc03d89 .

I'll let you know how things are next week.

Thanks for looking at this!

-Dale

Re: r6rs-ports.test is failing

[dsmich]

---- dsmich@roadrunner.com wrote: 
> ---- Andy Wingo <wingo@pobox.com> wrote: 
> > On Wed 01 Dec 2010 23:28, <dsmich@roadrunner.com> writes:
> > 
> > > The r6rs-ports.test is failing for me on a Debian Lenny 64bit system.
> > >
> > > $ git describe
> > > release_1-9-13-107-ga0ad8ad
> > >
> > > $ ./check-guile r6rs-ports.test
> > > Testing /home/dsmith/src/guile/meta/guile ... r6rs-ports.test
> > > with GUILE_LOAD_PATH=/home/dsmith/src/guile/test-suite
> > > Running r6rs-ports.test
> > > UNRESOLVED: r6rs-ports.test: 7.2.11 Binary Output: put-bytevector [2 args]
> > > UNRESOLVED: r6rs-ports.test: 7.2.11 Binary Output: put-bytevector [3 args]
> > > UNRESOLVED: r6rs-ports.test: 7.2.11 Binary Output: put-bytevector [4 args]
> > > ERROR: r6rs-ports.test: 8.2.6  Input and output ports: transcoded-port [error handling mode = replace] - arguments: ((encoding-error "scm_from_stringn" "input locale conversion error" 84 "UTF-8" "UTF-32" #vu8(255 1 2 3 103 110 117)))
> > 
> > I gather that this is still an issue, but that this code is being
> > rewritten; can you please ping us if this bug is still present next
> > weekend?
> 
> Yes, it's still an issue as of release_1-9-14-85-gbc03d89 .
> 
> I'll let you know how things are next week.

Well, I just noticed that it's not failing anymore.  I'm currently at release_1-9-14-99-gc52f77e
Not sure when that error went away.

Thanks,
  -Dale

Re: r6rs-ports.test is failing

[Ludovic Courtès]

Hello!

<dsmich@roadrunner.com> writes:

> ---- dsmich@roadrunner.com wrote: 
>> ---- Andy Wingo <wingo@pobox.com> wrote: 
>> > On Wed 01 Dec 2010 23:28, <dsmich@roadrunner.com> writes:
>> > 
>> > > The r6rs-ports.test is failing for me on a Debian Lenny 64bit system.
>> > >
>> > > $ git describe
>> > > release_1-9-13-107-ga0ad8ad
>> > >
>> > > $ ./check-guile r6rs-ports.test
>> > > Testing /home/dsmith/src/guile/meta/guile ... r6rs-ports.test
>> > > with GUILE_LOAD_PATH=/home/dsmith/src/guile/test-suite
>> > > Running r6rs-ports.test
>> > > UNRESOLVED: r6rs-ports.test: 7.2.11 Binary Output: put-bytevector [2 args]
>> > > UNRESOLVED: r6rs-ports.test: 7.2.11 Binary Output: put-bytevector [3 args]
>> > > UNRESOLVED: r6rs-ports.test: 7.2.11 Binary Output: put-bytevector [4 args]
>> > > ERROR: r6rs-ports.test: 8.2.6  Input and output ports: transcoded-port [error handling mode = replace] - arguments: ((encoding-error "scm_from_stringn" "input locale conversion error" 84 "UTF-8" "UTF-32" #vu8(255 1 2 3 103 110 117)))
>> > 
>> > I gather that this is still an issue, but that this code is being
>> > rewritten; can you please ping us if this bug is still present next
>> > weekend?
>> 
>> Yes, it's still an issue as of release_1-9-14-85-gbc03d89 .
>> 
>> I'll let you know how things are next week.
>
> Well, I just noticed that it's not failing anymore.  I'm currently at release_1-9-14-99-gc52f77e
> Not sure when that error went away.

It must have been a2c36371ce3de246bdb892afd50915ecf450df47, Wed. 26th.

Thanks,
Ludo’.