From mboxrd@z Thu Jan  1 00:00:00 1970
Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail
From: Visuwesh <visuweshm@gmail.com>
Newsgroups: gmane.emacs.bugs
Subject: bug#73638: 31.0.50;
 doc-view: imenu index cannot be made for LaTeX PDFs
Date: Sun, 06 Oct 2024 11:58:28 +0530
Message-ID: <87ttdphhir.fsf@gmail.com>
References: <87ploebyhc.fsf@gmail.com> <87ed4upbmf.fsf@gnu.org>
 <86plodvlcm.fsf@gnu.org>
Mime-Version: 1.0
Content-Type: multipart/mixed; boundary="=-=-="
Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214";
	logging-data="8381"; mail-complaints-to="usenet@ciao.gmane.io"
User-Agent: Gnus/5.13 (Gnus v5.13)
Cc: 73638@debbugs.gnu.org, Tassilo Horn <tsdh@gnu.org>
To: Eli Zaretskii <eliz@gnu.org>
Original-X-From: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Sun Oct 06 08:30:15 2024
Return-path: <bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org>
Envelope-to: geb-bug-gnu-emacs@m.gmane-mx.org
Original-Received: from lists.gnu.org ([209.51.188.17])
	by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
	(Exim 4.92)
	(envelope-from <bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org>)
	id 1sxKmT-00020R-Hs
	for geb-bug-gnu-emacs@m.gmane-mx.org; Sun, 06 Oct 2024 08:30:13 +0200
Original-Received: from localhost ([::1] helo=lists1p.gnu.org)
	by lists.gnu.org with esmtp (Exim 4.90_1)
	(envelope-from <bug-gnu-emacs-bounces@gnu.org>)
	id 1sxKmE-00083j-I3; Sun, 06 Oct 2024 02:29:58 -0400
Original-Received: from eggs.gnu.org ([2001:470:142:3::10])
 by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <Debian-debbugs@debbugs.gnu.org>)
 id 1sxKmD-00083a-U3
 for bug-gnu-emacs@gnu.org; Sun, 06 Oct 2024 02:29:57 -0400
Original-Received: from debbugs.gnu.org ([2001:470:142:5::43])
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128)
 (Exim 4.90_1) (envelope-from <Debian-debbugs@debbugs.gnu.org>)
 id 1sxKmD-0002nY-J5
 for bug-gnu-emacs@gnu.org; Sun, 06 Oct 2024 02:29:57 -0400
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed;
 d=debbugs.gnu.org; s=debbugs-gnu-org; 
 h=MIME-Version:Date:References:In-Reply-To:From:To:Subject;
 bh=6eiQLKWLMK1ckUNH13oHjHTTY3XTGOW7rGZ/0OIgHxY=; 
 b=v2OIfBfaG9KEjwLCfgy8ITybRRnlsqj0bvlR+xDLqsWUftEALZrC8Sll3bw/ORf677giI3WH8QrA5mXC3Jd784DQR/v3fLk7Mts7IS58sMk1FMG8JuBXpPvnulUrIaeJSNqwnRST/jSXAwElY0Q22y+7zuIxfkAWwaa+fLzRhziUgiLft60KqXU9yh6amx0bsEo6RAicgKO7BUKM0SfI1wAkcnTo+rVaspheLaWt4zRChcrs/09tlgvFjtz91XP+92o8u3Y4p1SWzNBPQOLyoiqWPvKxhB0r2NE6+bb3wchzExU/A8mT+cX0Fwy1oWFELB8SNjW6rBrNUibDwK58pg==;
Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2)
 (envelope-from <Debian-debbugs@debbugs.gnu.org>) id 1sxKmI-0003PM-Q7
 for bug-gnu-emacs@gnu.org; Sun, 06 Oct 2024 02:30:02 -0400
X-Loop: help-debbugs@gnu.org
Resent-From: Visuwesh <visuweshm@gmail.com>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces@debbugs.gnu.org>
Resent-CC: bug-gnu-emacs@gnu.org
Resent-Date: Sun, 06 Oct 2024 06:30:02 +0000
Resent-Message-ID: <handler.73638.B73638.172819618613051@debbugs.gnu.org>
Resent-Sender: help-debbugs@gnu.org
X-GNU-PR-Message: followup 73638
X-GNU-PR-Package: emacs
Original-Received: via spool by 73638-submit@debbugs.gnu.org id=B73638.172819618613051
 (code B ref 73638); Sun, 06 Oct 2024 06:30:02 +0000
Original-Received: (at 73638) by debbugs.gnu.org; 6 Oct 2024 06:29:46 +0000
Original-Received: from localhost ([127.0.0.1]:39983 helo=debbugs.gnu.org)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <debbugs-submit-bounces@debbugs.gnu.org>)
 id 1sxKm2-0003OR-4Y
 for submit@debbugs.gnu.org; Sun, 06 Oct 2024 02:29:46 -0400
Original-Received: from mail-pf1-f195.google.com ([209.85.210.195]:60920)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <visuweshm@gmail.com>) id 1sxKm0-0003OF-J2
 for 73638@debbugs.gnu.org; Sun, 06 Oct 2024 02:29:45 -0400
Original-Received: by mail-pf1-f195.google.com with SMTP id
 d2e1a72fcca58-718e2855479so2784498b3a.1
 for <73638@debbugs.gnu.org>; Sat, 05 Oct 2024 23:29:38 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=gmail.com; s=20230601; t=1728196113; x=1728800913; darn=debbugs.gnu.org;
 h=mime-version:user-agent:message-id:date:references:in-reply-to
 :subject:cc:to:from:from:to:cc:subject:date:message-id:reply-to;
 bh=6eiQLKWLMK1ckUNH13oHjHTTY3XTGOW7rGZ/0OIgHxY=;
 b=XLuSTqgl0GCkq/Nds7iU8+zTrbWkCZVhTT/9spq1ZQKgr8oKH0uQvkcPQG8J8rhI0N
 2cxYkGuY7Z6XwpGTVKDYS6i+NneTI2SUn/cA+eXCrdp1qYuIeYrodkKZsyhVpIVgY4L/
 P89o7ztL5aI1vKkQqAjn+B7e9WvJLpXVo3uA1x4zB8LqlIJasH2BV5rjjy5oogqHNHtV
 0G8uLDNN71TNFu6tChBkb/R/rJqWjrhTARMSSaOaKdH0OhKgLL1x81HYj2+ll6hJTNLA
 PsuMyAvDEDYvF3f5MXX9acjY2Z2JRwM3S/aCvYcfXKANl9kXGQfrplEgZqX7P02GYf2/
 gQTw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20230601; t=1728196113; x=1728800913;
 h=mime-version:user-agent:message-id:date:references:in-reply-to
 :subject:cc:to:from:x-gm-message-state:from:to:cc:subject:date
 :message-id:reply-to;
 bh=6eiQLKWLMK1ckUNH13oHjHTTY3XTGOW7rGZ/0OIgHxY=;
 b=NBTzoE6LLe3+eC+SyWjHghFVMAatGjeVKVQiarOg8p+0LwiRdj4il7h2Jp+nDp2IV1
 NY9R1zX5StudgPZQTThJQPNfEiz4ANHLJg4JyRkxbH7KbvatXUs5Lu+tCo5RaUEUvKyB
 7Nyd0l/GKt+KkUGNkL5xEQ+ncGIK/zITqBJ77Pgb+OojueIglyWRjK8D66htk6YQ+yyD
 FeVi6+iI8BEIGweJ2VAXkcFV+UH42zFzm515hvs9+nSntpW3Wjp76u4qzjNutGjkxIHS
 KM/BBK1NZfCisebknZy6xmwyY0Ljq3oomAmkNm+O4VoufgZJlFRuIik/wwh2V2p5eCga
 y4/g==
X-Forwarded-Encrypted: i=1;
 AJvYcCVkQl0BnzJhaMXxpMIfKBobyTEtZAzW2lc6XsfmCkoe1abBcVwPS4g42yeRWw8Ylem28LNRkg==@debbugs.gnu.org
X-Gm-Message-State: AOJu0YwVTf0EquGHqedO8+rUspKEbN6+2hqc17pI4SPVuXL/o7LRKRuD
 OQ3ZlebFkA1oa2Yt+Xmds1lADoUheS1XV5Ffgmf3OnNijk46Kp3NwOKRw6QU
X-Google-Smtp-Source: AGHT+IFZawaiW5OiUEUvI+CSUpao9hnb7zx5x/UZptU2+klYmQnQuwXxNswPGBktX4hnbSXVsQ1uMw==
X-Received: by 2002:a05:6a00:a96:b0:714:2dc9:fbaf with SMTP id
 d2e1a72fcca58-71de24514e3mr11850863b3a.18.1728196112877; 
 Sat, 05 Oct 2024 23:28:32 -0700 (PDT)
Original-Received: from localhost ([1.7.159.70]) by smtp.gmail.com with ESMTPSA id
 d2e1a72fcca58-71df0cbba11sm2417134b3a.15.2024.10.05.23.28.31
 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
 Sat, 05 Oct 2024 23:28:32 -0700 (PDT)
In-Reply-To: <86plodvlcm.fsf@gnu.org> (Eli Zaretskii's message of "Sun, 06 Oct
 2024 08:42:01 +0300")
X-BeenThere: debbugs-submit@debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
X-BeenThere: bug-gnu-emacs@gnu.org
List-Id: "Bug reports for GNU Emacs,
 the Swiss army knife of text editors" <bug-gnu-emacs.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/bug-gnu-emacs>,
 <mailto:bug-gnu-emacs-request@gnu.org?subject=unsubscribe>
List-Archive: <https://lists.gnu.org/archive/html/bug-gnu-emacs>
List-Post: <mailto:bug-gnu-emacs@gnu.org>
List-Help: <mailto:bug-gnu-emacs-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/bug-gnu-emacs>,
 <mailto:bug-gnu-emacs-request@gnu.org?subject=subscribe>
Errors-To: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org
Original-Sender: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org
Xref: news.gmane.io gmane.emacs.bugs:293071
Archived-At: <http://permalink.gmane.org/gmane.emacs.bugs/293071>

--=-=-=
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable

[=E0=AE=9E=E0=AE=BE=E0=AE=AF=E0=AE=BF=E0=AE=B1=E0=AF=81 =E0=AE=85=E0=AE=95=
=E0=AF=8D=E0=AE=9F=E0=AF=8B=E0=AE=AA=E0=AE=B0=E0=AF=8D 06, 2024] Eli Zarets=
kii wrote:

>> From: Tassilo Horn <tsdh@gnu.org>
>> Cc: 73638@debbugs.gnu.org, Eli Zaretskii <eliz@gnu.org>
>> Date: Sat, 05 Oct 2024 21:56:24 +0200
>>=20
>> Eli, the executive summary is this.  We already can read a PDFs outline
>> mutool and use that for quick access to chapters and sections through
>> imenu.  However, it turned out that it depends on the PDF at hand if the
>> outline is usable for our purpose where "usable" means we get page
>> references.  And it seems that many PDFs (e.g., those produced by LaTeX)
>> have no page references but named references which won't do the trick
>> for doc-view.
>>=20
>> Visuwesh figured out that one can run a JS script using "mutool run
>> <script> foo.pdf" for accessing the PDFs internal structure using the JS
>> mupdf API and wrote the below simple script which spits out the outline
>> with page references as sexp structure.
>>=20
>> Would it be ok to distribute the below JS helper script with Emacs so
>> that doc-view can use it?  If so, how?  Maybe the simplest way would be
>> to just put it in some doc-view--mutool-outline-script variable and copy
>> it to doc-view-cache-directory when invoking imenu on a PDF file the
>> first time?
>
> Can't we invoke the JS interpreter with this script as the command, or
> invoke it as async subprocess and pipe the script to it via standard
> input?

When "mutool run" is called without any script argument, it opens a
REPL.  We would need to `process-send-string' to the REPL but the REPL
reports syntax error when I try to do so.  This is after trying to
"minify" the JS script.  Maybe I am doing something wrong.  I've
attached my test lisp at the end.

I do not understand what you suggest by the former however.


--=-=-=
Content-Type: text/plain
Content-Disposition: attachment

(defvar test
  "var document = new Document.openDocument(\"%s\", \"application/pdf\")
var outline = document.loadOutline()
if(!outline) quit()

print(\"(\")

function pp(outl, level){ \
    print(\"((level . \" + level + \")\"); \
    print(\"(title . \" + repr(outl.title) + \")\"); \
    print(\"(page . \" + document.resolveLink(outl.uri) + \"))\"); \
    if(outl.down){ \
	for(var i=0; i<outl.down.length; i++){ \
	    pp(outl.down[i], level+1); \
	} \
    } \
}

for(var i=0; i<outline.length; i++){ \
    pp(outline[i], 1); \
}

print(\")\")")


(let ((default-directory "~/lib/emacs/straight/repos/pdf-tools/test/")
      proc)
  (with-current-buffer (get-buffer-create " *doc-view-mupdf-js*")
    (erase-buffer)
    (setq proc
          (make-process :name "mupdf-js"
                        :command (list "mutool" "run" )
                        :buffer (current-buffer)
                        :sentinel (lambda (proc _status)
                                    (when (eq (process-status proc) 'exit)
                                      (with-current-buffer (process-buffer proc)
                                        (goto-char (point-min))
                                        (message "%S" (read (current-buffer))))))))
    (process-send-string proc (format test (expand-file-name "test.pdf")))
    (process-send-eof proc)
    ))
--=-=-=--