bug#67717: 29.1; Eshell doesn't handle script with "#!/usr/bin/env python3 -ESs"

bug#67717: 29.1; Eshell doesn't handle script with "#!/usr/bin/env python3 -ESs"

[Sean Devlin]

Hi folks,

From Eshell, I'm trying to invoke a script with the interpreter line:

#!/usr/bin/env python3 -ESs

Instead of invoking the script, Eshell prints the line:

env: python3 -ESs: No such file or directory

Recipe:

1. Create a file with contents:

#!/usr/bin/env python3 -ESs
from sys import argv
print(argv)

2. M-x eshell
3. In Eshell, run the commands:

$ chmod +x /path/to/file
$ /path/to/file one two three

Expectation: Eshell should print the line:

['/path/to/file', 'one', 'two', 'three']

Result: Eshell prints the line:

env: python3 -ESs: No such file or directory

I think the problem is somewhere in esh-ext.el. Tracing the functions
eshell-find-interpreter and eshell-script-interpreter during execution
yields the following trace:

1 -> (eshell-find-interpreter "/path/to/file" ("one" "two" "three") nil)
| 2 -> (eshell-script-interpreter "/path/to/file")
| 2 <- eshell-script-interpreter: ("/usr/bin/env" "python3 -ESs" "/path/to/file")
| 2 -> (eshell-find-interpreter "/usr/bin/env" ("one" "two" "three") t)
| 2 <- eshell-find-interpreter: ("/usr/bin/env")
1 <- eshell-find-interpreter: ("/usr/bin/env" "python3 -ESs" "/path/to/file")

It looks like "python3 -ESs" has been parsed as a single argument to
env, but it should be split into two arguments.

Thanks!

In GNU Emacs 29.1 (build 1, aarch64-apple-darwin21.6.0, NS
appkit-2113.60 Version 12.6.6 (Build 21G646)) of 2023-08-16 built on
armbob.lan
Windowing system distributor 'Apple', version 10.3.2487
System Description:  macOS 14

Configured using:
'configure --with-ns '--enable-locallisppath=/Library/Application
Support/Emacs/${version}/site-lisp:/Library/Application
Support/Emacs/site-lisp' --with-modules 'CFLAGS=-DFD_SETSIZE=10000
-DDARWIN_UNLIMITED_SELECT' --with-x-toolkit=no'

Configured features:
ACL GLIB GMP GNUTLS JPEG JSON LIBXML2 MODULES NOTIFY KQUEUE NS PDUMPER
PNG RSVG SQLITE3 THREADS TIFF TOOLKIT_SCROLL_BARS TREE_SITTER ZLIB

Important settings:
  value of $LANG: en_US.UTF-8
  locale-coding-system: utf-8-unix

Major mode: Eshell

Minor modes in effect:
  shell-dirtrack-mode: t
  eshell-prompt-mode: t
  eshell-hist-mode: t
  eshell-pred-mode: t
  eshell-cmpl-mode: t
  eshell-proc-mode: t
  eshell-arg-mode: t
  tooltip-mode: t
  global-eldoc-mode: t
  show-paren-mode: t
  electric-indent-mode: t
  mouse-wheel-mode: t
  tool-bar-mode: t
  menu-bar-mode: t
  file-name-shadow-mode: t
  global-font-lock-mode: t
  font-lock-mode: t
  blink-cursor-mode: t
  line-number-mode: t
  indent-tabs-mode: t
  transient-mark-mode: t
  auto-composition-mode: t
  auto-encryption-mode: t
  auto-compression-mode: t

Load-path shadows:
None found.

Features:
(shadow sort mail-extr emacsbug message mailcap yank-media puny dired
dired-loaddefs rfc822 mml mml-sec password-cache epa derived epg rfc6068
epg-config gnus-util text-property-search time-date mm-decode mm-bodies
mm-encode mail-parse rfc2231 mailabbrev gmm-utils mailheader sendmail
rfc2047 rfc2045 ietf-drums mm-util mail-prsvr mail-utils cl-seq em-unix
em-term term disp-table shell subr-x ehelp em-script em-prompt em-ls
em-hist em-pred em-glob em-extpipe em-cmpl em-dirs esh-var pcomplete
comint ansi-osc ansi-color ring em-basic em-banner em-alias esh-mode
eshell esh-cmd generator cl-loaddefs cl-lib esh-ext esh-opt esh-proc
esh-io esh-arg esh-module esh-groups esh-util files-x rmc iso-transl
tooltip cconv eldoc paren electric uniquify ediff-hook vc-hooks
lisp-float-type elisp-mode mwheel term/ns-win ns-win ucs-normalize
mule-util term/common-win tool-bar dnd fontset image regexp-opt fringe
tabulated-list replace newcomment text-mode lisp-mode prog-mode register
page tab-bar menu-bar rfn-eshadow isearch easymenu timer select
scroll-bar mouse jit-lock font-lock syntax font-core term/tty-colors
frame minibuffer nadvice seq simple cl-generic indonesian philippine
cham georgian utf-8-lang misc-lang vietnamese tibetan thai tai-viet lao
korean japanese eucjp-ms cp51932 hebrew greek romanian slovak czech
european ethiopic indian cyrillic chinese composite emoji-zwj charscript
charprop case-table epa-hook jka-cmpr-hook help abbrev obarray oclosure
cl-preloaded button loaddefs theme-loaddefs faces cus-face macroexp
files window text-properties overlay sha1 md5 base64 format env
code-pages mule custom widget keymap hashtable-print-readable backquote
threads kqueue cocoa ns multi-tty make-network-process emacs)

Memory information:
((conses 16 57220 7333)
(symbols 48 7114 0)
(strings 32 20015 1685)
(string-bytes 1 653654)
(vectors 16 14649)
(vector-slots 8 204725 8629)
(floats 8 27 19)
(intervals 56 289 0)
(buffers 984 11))

bug#67717: 29.1; Eshell doesn't handle script with "#!/usr/bin/env python3 -ESs"

[Jim Porter]

tags 67717 notabug wontfix
thanks

On 12/8/2023 1:34 PM, Sean Devlin wrote:
>  From Eshell, I'm trying to invoke a script with the interpreter line:
> 
> #!/usr/bin/env python3 -ESs
> 
> Instead of invoking the script, Eshell prints the line:
> 
> env: python3 -ESs: No such file or directory

This is the correct behavior. The shebang syntax takes at most 2 values: 
the interpreter, and a single optional argument. Therefore, it's correct 
to interpret "python3 -ESs" as one argument. However, you can fix this 
with the "-S" option to env, e.g. "#!/usr/bin/env -S python3 -ESs". 
(I've confirmed locally that this works properly in Eshell.)

For more information, see here: 
<https://en.wikipedia.org/wiki/Shebang_(Unix)#Character_interpretation>

bug#67717: 29.1; Eshell doesn't handle script with "#!/usr/bin/env python3 -ESs"

[Sean Devlin]

> On Dec 8, 2023, at 5:58 PM, Jim Porter <jporterbugs@gmail.com> wrote:
> 
> tags 67717 notabug wontfix
> thanks
> 
>> On 12/8/2023 1:34 PM, Sean Devlin wrote:
>> From Eshell, I'm trying to invoke a script with the interpreter line:
>> #!/usr/bin/env python3 -ESs
>> Instead of invoking the script, Eshell prints the line:
>> env: python3 -ESs: No such file or directory
> 
> This is the correct behavior. The shebang syntax takes at most 2 values: the interpreter, and a single optional argument. Therefore, it's correct to interpret "python3 -ESs" as one argument. However, you can fix this with the "-S" option to env, e.g. "#!/usr/bin/env -S python3 -ESs". (I've confirmed locally that this works properly in Eshell.)
> 
> For more information, see here: <https://en.wikipedia.org/wiki/Shebang_(Unix)#Character_interpretation>

I see, thank you.

bug#67717: 29.1; Eshell doesn't handle script with "#!/usr/bin/env python3 -ESs"

[Stefan Kangas]

Sean Devlin <spd@toadstyle.org> writes:

>> This is the correct behavior. The shebang syntax takes at most 2 values: the interpreter, and a single optional argument. Therefore, it's correct to interpret "python3 -ESs" as one argument. However, you can fix this with the "-S" option to env, e.g. "#!/usr/bin/env -S python3 -ESs". (I've confirmed locally that this works properly in Eshell.)

I'm therefore closing this bug report.