Re: Fix for slow process output processing (please test).

[Jason Rumney <jasonr@gnu.org>]

storm@cua.dk (Kim F. Storm) writes:

> With the code below (provided by David some time ago), I see a big
> difference on the Linux 2.4 kernel I'm using (Redhat 9.0).
>
> Maybe someone can try it (just do M-x make-test) with and without
> adaptive buffering enabled on windows.

I have tried running the code, but I'm not sure I understand this well
enough to interpret the results. With adaptive buffering on, we get
more 1024 byte blocks, but we get nothing for Time: 0 (which may be a
symptom of the noticeable delay that was reported?), and we also have
a Time: 9, which I think might mean it is taking longer overall. The
numbers are all in at least the high hundreds for both tests, so maybe
Windows is doing some buffering behind the scenes anyway.


With adaptive buffering on:         With adaptive buffering off:

102400+0 records in                 102400+0 records in
102400+0 records out                102400+0 records out
finished                            finished
Time:  1                            Time:  0
   1 blocks with size  838             1 blocks with size  740
   1 blocks with size  860             2 blocks with size 1024
   1 blocks with size  882          Time:  1
   1 blocks with size  959             1 blocks with size  811
   8 blocks with size 1024             1 blocks with size  823
Time:  2                               1 blocks with size  830
   1 blocks with size  846             1 blocks with size  832
   1 blocks with size  971             1 blocks with size  925
   1 blocks with size  991             1 blocks with size  934
   9 blocks with size 1024             1 blocks with size  949
Time:  3                               1 blocks with size  959
   1 blocks with size  956             1 blocks with size  969
   1 blocks with size  969             1 blocks with size  995
   1 blocks with size  998             1 blocks with size 1024
   1 blocks with size 1017          Time:  2
   8 blocks with size 1024             1 blocks with size  728
Time:  4                               1 blocks with size  812
   1 blocks with size  846             1 blocks with size  815
   1 blocks with size  904             1 blocks with size  915
   1 blocks with size  927             1 blocks with size  925
   7 blocks with size 1024             1 blocks with size  930
Time:  5                               1 blocks with size  934
   1 blocks with size  888             1 blocks with size  939
   1 blocks with size  892             1 blocks with size  941
   1 blocks with size  904             1 blocks with size  961
   1 blocks with size  935             1 blocks with size  964
   8 blocks with size 1024             1 blocks with size  966
Time:  6                               1 blocks with size  984
   1 blocks with size  810             1 blocks with size  992
   1 blocks with size  830             1 blocks with size 1005
   1 blocks with size  875          Time:  3
   1 blocks with size  907             1 blocks with size  825
   8 blocks with size 1024             1 blocks with size  828
Time:  7                               1 blocks with size  873
   1 blocks with size  694             1 blocks with size  886
   1 blocks with size  852             1 blocks with size  929
   1 blocks with size  895             1 blocks with size  930
   1 blocks with size  921             2 blocks with size  933
   9 blocks with size 1024             1 blocks with size  947
Time:  8                               1 blocks with size  982
   1 blocks with size  841             1 blocks with size  988
   1 blocks with size  866             1 blocks with size  990
   1 blocks with size  929             1 blocks with size  993
   1 blocks with size  961             1 blocks with size 1000
   8 blocks with size 1024             1 blocks with size 1009
Time:  9                            Time:  4
   1 blocks with size  502             1 blocks with size  631
   1 blocks with size  575             1 blocks with size  811
   1 blocks with size  589             1 blocks with size  843
   1 blocks with size  608             1 blocks with size  891
   1 blocks with size  773             1 blocks with size  931
   1 blocks with size  886             1 blocks with size  935
   1 blocks with size  920             1 blocks with size  987
   1 blocks with size  992             1 blocks with size  989
   3 blocks with size 1024             1 blocks with size 1002
                                       1 blocks with size 1011
                                       1 blocks with size 1017
                                       3 blocks with size 1024
                                    Time:  5
                                       1 blocks with size  876
                                       1 blocks with size  879
                                       1 blocks with size  898
                                       1 blocks with size  908
                                       1 blocks with size  910
                                       1 blocks with size  912
                                       1 blocks with size  926
                                       1 blocks with size  990
                                       1 blocks with size  991
                                       1 blocks with size  996
                                       1 blocks with size  998
                                       2 blocks with size 1001
                                       1 blocks with size 1018
                                    Time:  6
                                       1 blocks with size  751
                                       1 blocks with size  874
                                       1 blocks with size  894
                                       1 blocks with size  912
                                       1 blocks with size  930
                                       1 blocks with size  944
                                       1 blocks with size  965
                                       1 blocks with size  995
                                       1 blocks with size 1002
                                       1 blocks with size 1007
                                       1 blocks with size 1012
                                    Time:  7
                                       1 blocks with size  849
                                       1 blocks with size  866
                                       1 blocks with size  902
                                       1 blocks with size  909
                                       1 blocks with size  912
                                       1 blocks with size  929
                                       1 blocks with size  940
                                       1 blocks with size  942
                                       1 blocks with size  945
                                       1 blocks with size  947
                                       1 blocks with size  951
                                       1 blocks with size  955
                                       1 blocks with size 1003
                                       1 blocks with size 1005
                                    Time:  8
                                       1 blocks with size  849
                                       1 blocks with size  852
                                       1 blocks with size  905
                                       1 blocks with size  922
                                       1 blocks with size  926
                                       1 blocks with size  927
                                       1 blocks with size  935
                                       1 blocks with size  940
                                       2 blocks with size  942
                                       1 blocks with size  943
                                       1 blocks with size  946
                                       1 blocks with size  951