To interrupt org-latex-pdf-process to regexp-replace some string of the .tex intermediate file and continue to export

To interrupt org-latex-pdf-process to regexp-replace some string of the .tex intermediate file and continue to export

[Leu Zhe]

[-- Attachment #1: Type: text/plain, Size: 805 bytes --]

I am using org-mode to write some article now. Org-mode is really a great
tool to outline a article with great table and image support.

Org-mode can display inline .png image but not .pdf file. Because now
org-mode can not control the width or height of shown inline image, so i
use matplotlib to produce low dpi .png image in PNG folder for inline
display and higher dpi pdf image in PDF folder for finally article export.

In .org file, the image link is like [[file:PNG\*.png]] and
\includegraphics{PNG\*.png}in the produced .tex file. Then emacs will use
org-latex-pdf-process to render it to pdf file. What I want is that before
or in org-latex-pdf-process, a regexp replace function is added to replace
the \includegraphics{PDF\*.pdf}, and then produce the final pdf file.

Can anyone give a hand?

[-- Attachment #2: Type: text/html, Size: 3649 bytes --]

Re: To interrupt org-latex-pdf-process to regexp-replace some string of the .tex intermediate file and continue to export

[Feng Shu]

Leu Zhe <lzhes43@gmail.com> writes:

> I am using org-mode to write some article now. Org-mode is really a
> great tool to outline a article with great table and image support.
>
> Org-mode can display inline .png image but not .pdf file. Because now
> org-mode can not control the width or height of shown inline image, so
> i use matplotlib to produce low dpi .png image in PNG folder for
> inline display and higher dpi pdf image in PDF folder for finally
> article export.
>
> In .org file, the image link is like [[file:PNG\*.png]] and
> \includegraphics{PNG\*.png}in the produced .tex file. Then emacs will
> use org-latex-pdf-process to render it to pdf file. What I want is
> that before or in org-latex-pdf-process, a regexp replace function is
> added to replace the \includegraphics{PDF\*.pdf}, and then produce the
> final pdf file.
>
> Can anyone give a hand?

I use R, Maybe this can help you ...

#+begin_src R :exports results :results output drawer :var backend=(symbol-name org-export-current-backend)
  require("ascii")
  plot.org  <- function (x, caption)
      {
          pngfile <- paste(caption, ".png", sep="")
          pdffile <- paste(caption, ".pdf", sep="")
          print(paragraph(paste("#+CAPTION: ", caption, sep="")),type="org")
          if (backend != "latex"){
              png(pngfile)
              plot(x)
              dev.off()
              print(paragraph(paste("[[./", pngfile, "]]", sep=""),new=FALSE),type="org")
          }else{
              pdf(pdffile)
              plot(x)
              dev.off()
              print(paragraph(paste("[[./", pdffile, "]]", sep=""),new=FALSE),type="org")
          }
      }

  plot.org(rnorm(100),"test")
#+end_src

-- 

Re: To interrupt org-latex-pdf-process to regexp-replace some string of the .tex intermediate file and continue to export

[John Kitchin]

[-- Attachment #1: Type: text/plain, Size: 2116 bytes --]

This is how I do what I think you are describing. I just take off the
extension, and let (pdf)latex pick the extension it wants.

(defun ox-manuscript-remove-image-extensions ()
  "Removes .png extensions from \includegraphics directives in an
exported latex file.

Run this from an org-buffer after you have exported it to a LaTeX file"
  (interactive)
  (let* ((org-file (file-name-nondirectory (buffer-file-name)))
         (tex-file (replace-regexp-in-string "org$" "tex" org-file))
         (tex-contents (with-temp-buffer (insert-file-contents
tex-file) (buffer-string))))
    (message tex-file)
    (with-temp-file tex-file (insert (replace-regexp-in-string
                                      (concat "\\(\\includegraphics"
                                              "\\(\[?[^\].*\]?\\)?\\)"
      ;; match optional [stuff]
                                              "{\\([^}].*\\)\.\\(png\\)}")
                                      "\\1{\\3}"  tex-contents)))))



John

-----------------------------------
John Kitchin
Associate Professor
Doherty Hall A207F
Department of Chemical Engineering
Carnegie Mellon University
Pittsburgh, PA 15213
412-268-7803
http://kitchingroup.cheme.cmu.edu



On Thu, Apr 24, 2014 at 8:46 AM, Leu Zhe <lzhes43@gmail.com> wrote:

>  I am using org-mode to write some article now. Org-mode is really a great
> tool to outline a article with great table and image support.
>
> Org-mode can display inline .png image but not .pdf file. Because now
> org-mode can not control the width or height of shown inline image, so i
> use matplotlib to produce low dpi .png image in PNG folder for inline
> display and higher dpi pdf image in PDF folder for finally article export.
>
> In .org file, the image link is like [[file:PNG\*.png]] and
> \includegraphics{PNG\*.png}in the produced .tex file. Then emacs will use
> org-latex-pdf-process to render it to pdf file. What I want is that
> before or in org-latex-pdf-process, a regexp replace function is added to
> replace the \includegraphics{PDF\*.pdf}, and then produce the final pdf
> file.
>
> Can anyone give a hand?
>

[-- Attachment #2: Type: text/html, Size: 7394 bytes --]

Re: To interrupt org-latex-pdf-process to regexp-replace some string of the .tex intermediate file and continue to export

[Leu Zhe]

[-- Attachment #1: Type: text/plain, Size: 3050 bytes --]

Dear John，

Thanks very much for your help.

I have tried your code but nothing happened. However, I think it is close
to my remand.

I have some questions about your code:

1. When should this command be called?  Don't I need to call it before the
org-latex-pdf-process?

2. I use xelatex to render my .tex files. Because xelatex can not recognize
the boundingbox of both .png and .pdf,
   so I need to generate .ebb for them in seperate folders, which are PNG
and PDF folders respectively. so i think
  you did not mention them?

I am studying elisp now, but your code is really difficult for me, so can
you help me dig in?

Best regard!




On Fri, Apr 25, 2014 at 10:54 PM, John Kitchin <jkitchin@andrew.cmu.edu>wrote:

> This is how I do what I think you are describing. I just take off the
> extension, and let (pdf)latex pick the extension it wants.
>
> (defun ox-manuscript-remove-image-extensions ()
>   "Removes .png extensions from \includegraphics directives in an exported latex file.
>
>
>
>
> Run this from an org-buffer after you have exported it to a LaTeX file"
>   (interactive)
>   (let* ((org-file (file-name-nondirectory (buffer-file-name)))
>          (tex-file (replace-regexp-in-string "org$" "tex" org-file))
>          (tex-contents (with-temp-buffer (insert-file-contents tex-file) (buffer-string))))
>
>
>
>     (message tex-file)
>     (with-temp-file tex-file (insert (replace-regexp-in-string
>
>
>
>                                       (concat "\\(\\includegraphics"
>                                               "\\(\[?[^\].*\]?\\)?\\)"       ;; match optional [stuff]
>
>
>
>                                               "{\\([^}].*\\)\.\\(png\\)}")
>                                       "\\1{\\3}"  tex-contents)))))
>
>
>
>
>
> John
>
> -----------------------------------
> John Kitchin
> Associate Professor
> Doherty Hall A207F
> Department of Chemical Engineering
> Carnegie Mellon University
> Pittsburgh, PA 15213
> 412-268-7803
> http://kitchingroup.cheme.cmu.edu
>
>
>
> On Thu, Apr 24, 2014 at 8:46 AM, Leu Zhe <lzhes43@gmail.com> wrote:
>
>>  I am using org-mode to write some article now. Org-mode is really a
>> great tool to outline a article with great table and image support.
>>
>> Org-mode can display inline .png image but not .pdf file. Because now
>> org-mode can not control the width or height of shown inline image, so i
>> use matplotlib to produce low dpi .png image in PNG folder for inline
>> display and higher dpi pdf image in PDF folder for finally article export.
>>
>> In .org file, the image link is like [[file:PNG\*.png]] and
>> \includegraphics{PNG\*.png}in the produced .tex file. Then emacs will
>> use org-latex-pdf-process to render it to pdf file. What I want is that
>> before or in org-latex-pdf-process, a regexp replace function is added
>> to replace the \includegraphics{PDF\*.pdf}, and then produce the final
>> pdf file.
>>
>> Can anyone give a hand?
>>
>
>

[-- Attachment #2: Type: text/html, Size: 8094 bytes --]

Re: To interrupt org-latex-pdf-process to regexp-replace some string of the .tex intermediate file and continue to export

[John Kitchin]

[-- Attachment #1: Type: text/plain, Size: 4049 bytes --]

You first export your org-file to latex. the function I sent assumes the
tex file has the same basename as the org-file, and ends in .tex.

Then, with your org-file as the current buffer, call that function. It will
modify the latex file by replacing your \includegraphics lines with the
equivalent line minus the .png.

then you need to manually build the latex file if you want the pdf.

I am not sure what an ebb file is, or what the difference in latex vs
xelatex is.

https://github.com/jkitchin/jmax/blob/master/ox-manuscript.el

John

-----------------------------------
John Kitchin
Associate Professor
Doherty Hall A207F
Department of Chemical Engineering
Carnegie Mellon University
Pittsburgh, PA 15213
412-268-7803
http://kitchingroup.cheme.cmu.edu



On Fri, Apr 25, 2014 at 11:23 AM, Leu Zhe <lzhes43@gmail.com> wrote:

> Dear John，
>
> Thanks very much for your help.
>
> I have tried your code but nothing happened. However, I think it is close
> to my remand.
>
> I have some questions about your code:
>
> 1. When should this command be called?  Don't I need to call it before the
> org-latex-pdf-process?
>
> 2. I use xelatex to render my .tex files. Because xelatex can not
> recognize the boundingbox of both .png and .pdf,
>    so I need to generate .ebb for them in seperate folders, which are PNG
> and PDF folders respectively. so i think
>   you did not mention them?
>
> I am studying elisp now, but your code is really difficult for me, so can
> you help me dig in?
>
> Best regard!
>
>
>
>
> On Fri, Apr 25, 2014 at 10:54 PM, John Kitchin <jkitchin@andrew.cmu.edu>wrote:
>
>> This is how I do what I think you are describing. I just take off the
>> extension, and let (pdf)latex pick the extension it wants.
>>
>> (defun ox-manuscript-remove-image-extensions ()
>>   "Removes .png extensions from \includegraphics directives in an exported latex file.
>>
>>
>>
>>
>>
>> Run this from an org-buffer after you have exported it to a LaTeX file"
>>   (interactive)
>>   (let* ((org-file (file-name-nondirectory (buffer-file-name)))
>>          (tex-file (replace-regexp-in-string "org$" "tex" org-file))
>>          (tex-contents (with-temp-buffer (insert-file-contents tex-file) (buffer-string))))
>>
>>
>>
>>
>>     (message tex-file)
>>     (with-temp-file tex-file (insert (replace-regexp-in-string
>>
>>
>>
>>
>>                                       (concat "\\(\\includegraphics"
>>                                               "\\(\[?[^\].*\]?\\)?\\)"       ;; match optional [stuff]
>>
>>
>>
>>
>>                                               "{\\([^}].*\\)\.\\(png\\)}")
>>                                       "\\1{\\3}"  tex-contents)))))
>>
>>
>>
>>
>>
>>
>> John
>>
>> -----------------------------------
>> John Kitchin
>> Associate Professor
>> Doherty Hall A207F
>> Department of Chemical Engineering
>> Carnegie Mellon University
>> Pittsburgh, PA 15213
>> 412-268-7803
>> http://kitchingroup.cheme.cmu.edu
>>
>>
>>
>> On Thu, Apr 24, 2014 at 8:46 AM, Leu Zhe <lzhes43@gmail.com> wrote:
>>
>>>  I am using org-mode to write some article now. Org-mode is really a
>>> great tool to outline a article with great table and image support.
>>>
>>> Org-mode can display inline .png image but not .pdf file. Because now
>>> org-mode can not control the width or height of shown inline image, so i
>>> use matplotlib to produce low dpi .png image in PNG folder for inline
>>> display and higher dpi pdf image in PDF folder for finally article export.
>>>
>>> In .org file, the image link is like [[file:PNG\*.png]] and
>>> \includegraphics{PNG\*.png}in the produced .tex file. Then emacs will
>>> use org-latex-pdf-process to render it to pdf file. What I want is that
>>> before or in org-latex-pdf-process, a regexp replace function is added
>>> to replace the \includegraphics{PDF\*.pdf}, and then produce the final
>>> pdf file.
>>>
>>> Can anyone give a hand?
>>>
>>
>>
>

[-- Attachment #2: Type: text/html, Size: 9642 bytes --]

Re: To interrupt org-latex-pdf-process to regexp-replace some string of the .tex intermediate file and continue to export

[Kyutech]

[-- Attachment #1: Type: text/plain, Size: 4539 bytes --]

John, thanks you very much.

Your code really satisfies my  demand. I plan to use your function to
replace org-export.

Thanks again, and thanks Nick for your explanation.

Best regards.




On Sat, Apr 26, 2014 at 1:56 AM, John Kitchin <jkitchin@andrew.cmu.edu>wrote:

> You first export your org-file to latex. the function I sent assumes the
> tex file has the same basename as the org-file, and ends in .tex.
>
> Then, with your org-file as the current buffer, call that function. It
> will modify the latex file by replacing your \includegraphics lines with
> the equivalent line minus the .png.
>
> then you need to manually build the latex file if you want the pdf.
>
> I am not sure what an ebb file is, or what the difference in latex vs
> xelatex is.
>
> https://github.com/jkitchin/jmax/blob/master/ox-manuscript.el
>
> John
>
> -----------------------------------
> John Kitchin
> Associate Professor
> Doherty Hall A207F
> Department of Chemical Engineering
> Carnegie Mellon University
> Pittsburgh, PA 15213
> 412-268-7803
> http://kitchingroup.cheme.cmu.edu
>
>
>
> On Fri, Apr 25, 2014 at 11:23 AM, Leu Zhe <lzhes43@gmail.com> wrote:
>
>> Dear John，
>>
>> Thanks very much for your help.
>>
>> I have tried your code but nothing happened. However, I think it is close
>> to my remand.
>>
>> I have some questions about your code:
>>
>> 1. When should this command be called?  Don't I need to call it before
>> the org-latex-pdf-process?
>>
>> 2. I use xelatex to render my .tex files. Because xelatex can not
>> recognize the boundingbox of both .png and .pdf,
>>    so I need to generate .ebb for them in seperate folders, which are PNG
>> and PDF folders respectively. so i think
>>   you did not mention them?
>>
>> I am studying elisp now, but your code is really difficult for me, so can
>> you help me dig in?
>>
>> Best regard!
>>
>>
>>
>>
>> On Fri, Apr 25, 2014 at 10:54 PM, John Kitchin <jkitchin@andrew.cmu.edu>wrote:
>>
>>> This is how I do what I think you are describing. I just take off the
>>> extension, and let (pdf)latex pick the extension it wants.
>>>
>>> (defun ox-manuscript-remove-image-extensions ()
>>>   "Removes .png extensions from \includegraphics directives in an exported latex file.
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> Run this from an org-buffer after you have exported it to a LaTeX file"
>>>   (interactive)
>>>   (let* ((org-file (file-name-nondirectory (buffer-file-name)))
>>>          (tex-file (replace-regexp-in-string "org$" "tex" org-file))
>>>          (tex-contents (with-temp-buffer (insert-file-contents tex-file) (buffer-string))))
>>>
>>>
>>>
>>>
>>>
>>>
>>>     (message tex-file)
>>>     (with-temp-file tex-file (insert (replace-regexp-in-string
>>>
>>>
>>>
>>>
>>>
>>>
>>>                                       (concat "\\(\\includegraphics"
>>>                                               "\\(\[?[^\].*\]?\\)?\\)"       ;; match optional [stuff]
>>>
>>>
>>>
>>>
>>>
>>>
>>>                                               "{\\([^}].*\\)\.\\(png\\)}")
>>>                                       "\\1{\\3}"  tex-contents)))))
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> John
>>>
>>> -----------------------------------
>>> John Kitchin
>>> Associate Professor
>>> Doherty Hall A207F
>>> Department of Chemical Engineering
>>> Carnegie Mellon University
>>> Pittsburgh, PA 15213
>>> 412-268-7803
>>> http://kitchingroup.cheme.cmu.edu
>>>
>>>
>>>
>>> On Thu, Apr 24, 2014 at 8:46 AM, Leu Zhe <lzhes43@gmail.com> wrote:
>>>
>>>>  I am using org-mode to write some article now. Org-mode is really a
>>>> great tool to outline a article with great table and image support.
>>>>
>>>> Org-mode can display inline .png image but not .pdf file. Because now
>>>> org-mode can not control the width or height of shown inline image, so i
>>>> use matplotlib to produce low dpi .png image in PNG folder for inline
>>>> display and higher dpi pdf image in PDF folder for finally article export.
>>>>
>>>> In .org file, the image link is like [[file:PNG\*.png]] and
>>>> \includegraphics{PNG\*.png}in the produced .tex file. Then emacs will
>>>> use org-latex-pdf-process to render it to pdf file. What I want is
>>>> that before or in org-latex-pdf-process, a regexp replace function is
>>>> added to replace the \includegraphics{PDF\*.pdf}, and then produce the
>>>> final pdf file.
>>>>
>>>> Can anyone give a hand?
>>>>
>>>
>>>
>>
>

[-- Attachment #2: Type: text/html, Size: 10548 bytes --]

Re: To interrupt org-latex-pdf-process to regexp-replace some string of the .tex intermediate file and continue to export

[Nick Dokos]

Leu Zhe <lzhes43@gmail.com> writes:

> Dear John，
>
> Thanks very much for your help.
>
> I have tried your code but nothing happened. However, I think it is close to my remand. 
>
> I have some questions about your code:
>
> 1. When should this command be called?  Don't I need to call it before the org-latex-pdf-process?
>

As it says in the comment:

"Run this from an org-buffer after you have exported it to a LaTeX file"

The function assumes that you have already produced a .tex file from
your .org file (e.g. with C-c C-e l l). Then, in your org file buffer
you call it:

    M-x ox-manuscript-remove-image-extensions RET

> I am studying elisp now, but your code is really difficult for me, so can you help me dig in? 

What the function does is get the filename for the current buffer
(i.e. the name of your org file), derive the name of the produced
tex file, get the contents of the tex file assigned (as a string)
to tex-contents, do a search-and-replace operation on tex-contents
and write the result back into the tex file. The search-and-replace
operation searches for strings that look like this:

          \includegraphics[...]{foo.png}

and replaces each occurrence with

          \includegraphics[...]{foo}

Nick

Re: To interrupt org-latex-pdf-process to regexp-replace some string of the .tex intermediate file and continue to export

[John Kitchin]

[-- Attachment #1: Type: text/plain, Size: 2497 bytes --]

Thanks Nick, for the more helpful explanation than mine ;)

The function I provided is part of this file:
https://github.com/jkitchin/jmax/blob/master/ox-manuscript.el

which I have been working on for publishing scientific manuscripts. This
file provides a new export menu option that not only removes the extensions
in the latex file, but also replaces the \bibliography{} line with the
contents of the .bbl file so that you have a single, standalone tex file
for submission. There is even an export and mail option for a pdf ;)

With this library installed, you can just type: C-c C-e j m
to build your latex file with extensions removed, bibliography replaced,
and open the pdf through the regular org-mode export menu. This may be more
helpful than trying to do the steps manually as I described.

John

-----------------------------------
John Kitchin
Associate Professor
Doherty Hall A207F
Department of Chemical Engineering
Carnegie Mellon University
Pittsburgh, PA 15213
412-268-7803
http://kitchingroup.cheme.cmu.edu



On Fri, Apr 25, 2014 at 1:06 PM, Nick Dokos <ndokos@gmail.com> wrote:

> Leu Zhe <lzhes43@gmail.com> writes:
>
> > Dear John，
> >
> > Thanks very much for your help.
> >
> > I have tried your code but nothing happened. However, I think it is
> close to my remand.
> >
> > I have some questions about your code:
> >
> > 1. When should this command be called?  Don't I need to call it before
> the org-latex-pdf-process?
> >
>
> As it says in the comment:
>
> "Run this from an org-buffer after you have exported it to a LaTeX file"
>
> The function assumes that you have already produced a .tex file from
> your .org file (e.g. with C-c C-e l l). Then, in your org file buffer
> you call it:
>
>     M-x ox-manuscript-remove-image-extensions RET
>
> > I am studying elisp now, but your code is really difficult for me, so
> can you help me dig in?
>
> What the function does is get the filename for the current buffer
> (i.e. the name of your org file), derive the name of the produced
> tex file, get the contents of the tex file assigned (as a string)
> to tex-contents, do a search-and-replace operation on tex-contents
> and write the result back into the tex file. The search-and-replace
> operation searches for strings that look like this:
>
>           \includegraphics[...]{foo.png}
>
> and replaces each occurrence with
>
>           \includegraphics[...]{foo}
>
> Nick
>
>
>
>

[-- Attachment #2: Type: text/html, Size: 3344 bytes --]

Re: To interrupt org-latex-pdf-process to regexp-replace some string of the .tex intermediate file and continue to export

[Leu Zhe]

[-- Attachment #1: Type: text/plain, Size: 116 bytes --]

Dear Feng Shu,

Thanks very much for your help.

I am not familiar with R, but I will test it later.

Best regards!

[-- Attachment #2: Type: text/html, Size: 209 bytes --]