RLT (hebrew) tables and org-odt-export-to-odt problems

RLT (hebrew) tables and org-odt-export-to-odt problems

[Uwe Brauer]

[-- Attachment #1: Type: text/plain, Size: 509 bytes --]

Hello 


Please consider the following example of a hebrew text, which is written
in logical form. 

  פרויקט   לשמור  מגדל   פיזה  שעלה  20  מיליון   אירו  השלים      לאחרונה. 

When exported to odt, the first sentence is displayed correctly.
However when I try to put it in a table as the following lines
indicates.

Then this table is displayed L2R.

|  פרויקט|   לשמור|  מגדל|   פיזה|  שעלה|  20|  מיליון |  אירו|  השלים  |    לאחרונה.| 
 

I attach the odt file.

This seems a sort of bug?

Uwe Brauer 


[-- Attachment #2: pisa-inter.odt --]
[-- Type: application/vnd.oasis.opendocument.text, Size: 10082 bytes --]

Re: RLT (hebrew) tables and org-odt-export-to-odt problems

[Jambunathan K]

In LibreOffice, 

    Right click on the table->Table->Text Direction->Right-to-Left.

Now, does what you see seem right to you?

As a side-note, the OrgOdtStyles.xml using a LibreOffice that uses en-GB
(IN).  So, there could be "issues" when it is used with "other"
languages.

You will be better of creating a .ott file that uses language and
country of your choice.

See Tools->Options->Language Settings->Languages->Default Languages for
Documents->Whatever.

I have seen recommendations of using CTL->Hebrew.

----------------------------------------------------------------

As an experiment, look at your *Messages* buffer and see where the
exporter is loading OrgOdtStyles.xml from.  In the same directory, there
would be a OrgOdtContentTemplate.xml.  Look for the "OrgTable" style
spec.

    <style:style style:name="OrgTable" style:family="table">
      <style:table-properties style:rel-width="96%" fo:margin-top="0cm" fo:margin-bottom="0.20cm" table:align="center"/>
    </style:style>

Add a style:writing-mode="rl-tb" to the table-properties. i.e., do this

    <style:style style:name="OrgTable" style:family="table">
      <style:table-properties style:rel-width="96%" fo:margin-top="0cm"
      fo:margin-bottom="0.20cm" table:align="center" style:writing-mode="rl-tb"/>
    </style:style>

Now re-export.  See whether things are OK.

Rememeber, the style "OrgTable" (which is an automatic style because it
comes from content.xml and not styles.xml) gets applied to ALL your
tables.

----------------------------------------------------------------

As a developer note, the ox-odt.el already can create automatic-style
for tables.  If a table has a rel-width attr_odt line, it would use an
automatic style.  So it is just a matter of few 15 minutes for one to
add support for how a table is rendered.

----------------------------------------------------------------

Since we have an exporter framework in place, the question I would
probably ask is what does LaTeX do.  Meaning, is there a need to mark a
table as rtl when being exported to LaTeX.  If yes, what would be the
specific attribute that the maintainer of ox.el recommend.

----------------------------------------------------------------

I will queue up a fix for this in my private repo:

        http://repo.or.cz/w/org-mode/org-kjn.git

I WILL merge my fixes and improvements once Emacs has the current
release cycle for Emacs is over.  If you try out the suggestions above
and give me feedback, I will factor in input in to my fix.

----------------------------------------------------------------

Uwe Brauer <oub@mat.ucm.es> writes:

> Hello 
>
>
> Please consider the following example of a hebrew text, which is written
> in logical form. 
>
>   פרויקט   לשמור  מגדל   פיזה  שעלה  20  מיליון   אירו  השלים      לאחרונה. 
>
> When exported to odt, the first sentence is displayed correctly.
> However when I try to put it in a table as the following lines
> indicates.
>
> Then this table is displayed L2R.
>
> | פרויקט| לשמור| מגדל| פיזה| שעלה| 20| מיליון | אירו| השלים |
> לאחרונה.|
>  
>
> I attach the odt file.
>
> This seems a sort of bug?
>
> Uwe Brauer 

Re: RLT (hebrew) tables and org-odt-export-to-odt problems

[Uwe Brauer]

[-- Attachment #1: Type: text/plain, Size: 3071 bytes --]

>> "Jambunathan" == Jambunathan K <Jambunathan> writes:

Strangely enough, I don't see your answer on gmane.
   > In LibreOffice, 

   >     Right click on the table->Table->Text Direction->Right-to-Left.

Aha, 
   > Now, does what you see seem right to you?

Yes indeed it does!!

I fiddled around with a function which converts the order of the words,
not the letters in the row[1]. But this solution is better, it never
occurred to me to look for such a functionality in OO (I am using AOO,
because of a bug in LibreOffice concerning niqqud in hebrew)
 

   > As a side-note, the OrgOdtStyles.xml using a LibreOffice that uses en-GB
   > (IN).  So, there could be "issues" when it is used with "other"
   > languages.

   > You will be better of creating a .ott file that uses language and
   > country of your choice.

   > See Tools->Options->Language Settings->Languages->Default Languages for
   Documents-> Whatever.

   > I have seen recommendations of using CTL->Hebrew.


This I have activated of course, but this is for documents which are 
*generated* by OO.

   > ----------------------------------------------------------------

   > As an experiment, look at your *Messages* buffer and see where the
   > exporter is loading OrgOdtStyles.xml from.  In the same directory, there
   > would be a OrgOdtContentTemplate.xml.  Look for the "OrgTable" style
   > spec.

There is a problem. 
I attach parts of the *Messages* buffer. It seems he does this in a
directory in /tmp/odt-1217v_I/
but the directory is already deleted, can this be?


,----
| Debug (ox-odt): Searching for OpenDocument styles files...
| Debug (ox-odt): Trying /usr/share/emacs/etc/org/styles/... [2 times]
| Debug (ox-odt): Trying /home/oub/.emacs.d/etc/styles/...
| Debug (ox-odt): Trying /home/oub/.emacs.d/elpa/org-20130617/etc/styles/...
| Debug (ox-odt): Using styles under /home/oub/.emacs.d/elpa/org-20130617/etc/styles/
| Debug (ox-odt): Searching for OpenDocument schema files...
| Debug (ox-odt): Trying /usr/share/emacs/etc/org/schema/... [2 times]
| Debug (ox-odt): No OpenDocument schema files installed
| Using vacuous schema
| LaTeX to MathML converter not available.
| Formatting LaTeX using verbatim
| Wrote /tmp/odt-1217v_I/meta.xml
| Using vacuous schema [2 times]
| Saving file /tmp/odt-1217v_I/styles.xml...
| Wrote /tmp/odt-1217v_I/styles.xml
| Wrote /tmp/odt-1217v_I/mimetype
| Using vacuous schema
| Saving file /tmp/odt-1217v_I/META-INF/manifest.xml...
| Wrote /tmp/odt-1217v_I/META-INF/manifest.xml
| Saving file /tmp/odt-1217v_I/content.xml...
| Wrote /tmp/odt-1217v_I/content.xml
| (No changes need to be saved)
| Creating ODT file...
| Running zip -mX0 tabler2l.odt mimetype
| Running zip -rmTq tabler2l.odt .
`----



   > Now re-export.  See whether things are OK.

I am keen to test this, but right now I am stacked since I don't know
where to find these style files.


BTW there is another problem with table export which I will report in a
different message.

Uwe 

[-- Attachment #2: smime.p7s --]
[-- Type: application/pkcs7-signature, Size: 5556 bytes --]

NOT SOLVED Re: RLT (hebrew) tables and org-odt-export-to-odt problems

[Uwe Brauer]

[-- Attachment #1: Type: text/plain, Size: 477 bytes --]

>> "Jambunathan" == Jambunathan K <Jambunathan> writes:

   > In LibreOffice, 

   >     Right click on the table->Table->Text Direction->Right-to-Left.

   > Now, does what you see seem right to you?

Sorry, my answer was premature.
Your solutions, converts the order of all rows, but this is not correct
in general, for example
if the first is hebrew R2L, but the second is L2R.

So your solutions solves the hebrew part but screws up the english part.

Uwe 

[-- Attachment #2: smime.p7s --]
[-- Type: application/pkcs7-signature, Size: 5556 bytes --]

org-odt-export-to-odt, tables bug in OO

[Uwe Brauer]

[-- Attachment #1.1: Type: text/plain, Size: 2557 bytes --]


OO and Libre Office have a langstanding bug 

https://issues.apache.org/ooo/show_bug.cgi?id=7747

The select all function does not work in a  document which starts with a
table there is a workaround but this workaround does not work for odt
files generated by the org converter.

Now I generated by the org converter a document which I attach,
Please look at the following document, which has been generated by a
converter provided by org[.

It contains tables which whose text cannot be selected via select all.
If there is something wrong with the odt, please tell me and I will
report it on the org mailing list.

thanks

Uwe Brauer 
now johnny smith <kanni@krovatka.su> told me:

,----
| 
| notwithstanding dave's comment, the odt seems either defective or
| incompatible with aoo (which may be aoo's fault as well). more
| specifically, the tables are quite lonely within their sections. they
| have no text before them, nor after. such a document can't be created
| by usual means of aoo, and thus it isn't handled as expected. e.g.,
| you can't type anything after the second table or after the first one
| within its section, because there're no empty paragraphs after the
| tables to take your input. you can't even peform select-all operation
| manually (with a mouse rather than through ctrl+a). it seems that the
| select operation uses contents of the <text:p> elements to set
| boundaries of the selection. so, if there's no such element, then
| select-all doesn't work properly.
| 
| to fix this, i inserted the following two paragraphs into content.xml of your file:
| 
| <text:p text:style-name="OrgTableContentsLeft">some text after the first table</text:p>
| <text:p text:style-name="OrgTableContentsLeft">some text after the second table</text:p>
| 
| they follow the closing tags (</table:table>) of tables. there
| appeared to be no way to do it through gui.
| 
| after that select-all worked almost smoothly: it selected the cell on
| the first press, the table on the second one and everything on the
| third one. what was wrong is that it always started with the cell,
| even when the caret was outside table.
| 
| however, inserting a paragraph before each table fixed this. it didn't
| require editing content.xml. the final version of the file is
| attached, and i hope it won't be attenuated by antispam.
| 
| i can't say on which program's account this bug is. consulting odf
| specification may help answer this question
`----

I attach both files:


Uwe Brauer 

[-- Attachment #1.2: testorg.odt --]
[-- Type: application/vnd.oasis.opendocument.text, Size: 10319 bytes --]

[-- Attachment #1.3: testorg-ok.odt --]
[-- Type: application/vnd.oasis.opendocument.text, Size: 14630 bytes --]

[-- Attachment #2: smime.p7s --]
[-- Type: application/pkcs7-signature, Size: 5556 bytes --]

Re: RLT (hebrew) tables and org-odt-export-to-odt problems

[Uwe Brauer]

[-- Attachment #1.1: Type: text/plain, Size: 602 bytes --]

>> "Jambunathan" == Jambunathan K <Jambunathan> writes:

   > In LibreOffice, 

   >     Right click on the table->Table->Text Direction->Right-to-Left.

I attach three files.

 r2ltableOO.odt has been generated by OO, and displays the text as
 intended.

r2ltableorg.org is the org file and displays the text as
intended. However not all of the text was written in logical order by
GNU emacs, but copied from some other sources.


r2ltableorg.odt is the result of the converter, which is not the same as
OO produces. So maybe some direction marker is needed in the L2R text?





[-- Attachment #1.2: r2ltableorg.odt --]
[-- Type: application/vnd.oasis.opendocument.text, Size: 9983 bytes --]

[-- Attachment #1.3: r2ltableorg.org --]
[-- Type: text/x-org, Size: 66 bytes --]

שלום דוד 

Hello David

| שלום  | דוד   |
| David |hello  |

[-- Attachment #1.4: r2ltableOO.odt --]
[-- Type: application/vnd.oasis.opendocument.text, Size: 10886 bytes --]

[-- Attachment #2: smime.p7s --]
[-- Type: application/pkcs7-signature, Size: 5556 bytes --]

Re: RLT (hebrew) tables and org-odt-export-to-odt problems

[Jambunathan K]

Uwe 

> r2ltableorg.org is the org file and displays the text as
> intended. However not all of the text was written in logical order by
> GNU emacs, but copied from some other sources.

I am venturing in to the wild here and it will take multiple iterations
for me to even get a "feel" for what needs to be happen.  I am not even
sure what is right or wrong here.  Anyways...

----------------------------------------------------------------

Further to our exchange on the emacs-devel list,

    http://lists.gnu.org/archive/html/emacs-devel/2013-11/msg00134.html

I see that the file you passed me has no bi-directional markers
whatsoever.  I think presence of markers would affect how libreoffice
would layout the table.

I suggest that you pass me an Org file, that has the right
bidi-paragraph-direction (as a local variable) and has the right set of
bidi markers.

(Furthermore, explicitly mark the org file as utf-8 coded.  I am not
sure what coding system the attachment is coded to.  When I view the
attachment in Gnus, I only see the latin characters.)

----------------------------------------------------------------

As for getting the table cells laid right, try this out.

1. Export a hebrew.org file to hebrew.odt
2. Open the .odt file in LibreOffice.

   F11->Page Style->Default Page Style->Page->Text Direction->Set it to
   "Right to Left".

   I think that this would set the predominant direction of your
   document.  I believe, it would correspond to bidi-paragraph-direction
   setting.

3. File->Save as->somefile.ott

   Now in your hebrew.org file, add this directive

   #+ODT_STYLES_FILE: "hebrew.ott"

   This will make the exported document an R2L document.

4. Export again.  See what happens

----------------------------------------------------------------

(The process is the same for setting your preferred font.)

Re: RLT (hebrew) tables and org-odt-export-to-odt problems

[Uwe Brauer]

[-- Attachment #1: Type: text/plain, Size: 2228 bytes --]

>> "Jambunathan" == Jambunathan K <Jambunathan> writes:
Hi Jambunathan, 
   > Uwe 



   > I am venturing in to the wild here and it will take multiple iterations
   > for me to even get a "feel" for what needs to be happen.  I am not even
   > sure what is right or wrong here.  Anyways...
   > ----------------------------------------------------------------
thanks very much for all your efforts so far.


   > Further to our exchange on the emacs-devel list,

   >     http://lists.gnu.org/archive/html/emacs-devel/2013-11/msg00134.html

   > I see that the file you passed me has no bi-directional markers
   > whatsoever.  I think presence of markers would affect how libreoffice
   > would layout the table.

   > I suggest that you pass me an Org file, that has the right
   > bidi-paragraph-direction (as a local variable) and has the right set of
   > bidi markers.


I tried and that and it did not help I send the files anyway, I will
however use thunderbird to send the attachments in the next mails.

   > (Furthermore, explicitly mark the org file as utf-8 coded.  I am not
   > sure what coding system the attachment is coded to.  When I view the
   > attachment in Gnus, I only see the latin characters.)

   > ----------------------------------------------------------------

   > As for getting the table cells laid right, try this out.

   > 1. Export a hebrew.org file to hebrew.odt
   > 2. Open the .odt file in LibreOffice.

   F11-> Page Style->Default Page Style->Page->Text Direction->Set it to
   >    "Right to Left".

This does not really work, since it switches the direction of all rows
in the table, but not just of the first one as suggested Eli.

   >    I think that this would set the predominant direction of your
   >    document.  I believe, it would correspond to bidi-paragraph-direction
   >    setting.

   > 3. File->Save as->somefile.ott

   >    Now in your hebrew.org file, add this directive

   >    #+ODT_STYLES_FILE: "hebrew.ott"

   >    This will make the exported document an R2L document.

   > 4. Export again.  See what happens

I tried same result.


I send all files in question in my next email.

Uwe 

[-- Attachment #2: smime.p7s --]
[-- Type: application/pkcs7-signature, Size: 5556 bytes --]

Re: RLT (hebrew) tables and org-odt-export-to-odt problems

[Uwe Brauer]

[-- Attachment #1.1: Type: text/plain, Size: 237 bytes --]

On 11/04/2013 07:08 AM, Jambunathan K wrote:
>
> I suggest that you pass me an Org file, that has the right
> bidi-paragraph-direction (as a local variable) and has the right set of
> bidi markers.
Here are the attached files.



[-- Attachment #1.2: hebrew.ott --]
[-- Type: application/vnd.oasis.opendocument.text-template, Size: 13302 bytes --]

[-- Attachment #1.3: hebrew-l2r.odt --]
[-- Type: application/vnd.oasis.opendocument.text, Size: 9573 bytes --]

[-- Attachment #1.4: hebrew-l2r.org --]
[-- Type: text/plain, Size: 190 bytes --]

#+ODT_STYLES_FILE: "hebrew.ott"


שלום דוד

David Hallo



|שלום| דוד| 
|David |Hallo|


#  Local Variables: 
#  eval: (setq bidi-paragraph-direction 'left-to-right) 
#  End:


[-- Attachment #1.5: hebrew-r2l.odt --]
[-- Type: application/vnd.oasis.opendocument.text, Size: 9573 bytes --]

[-- Attachment #1.6: hebrew-r2l.org --]
[-- Type: text/plain, Size: 188 bytes --]

#+ODT_STYLES_FILE: "hebrew.ott"

שלום דוד

David Hallo



|שלום| דוד| 
|David |Hallo|


#  Local Variables: 
#  eval: (setq bidi-paragraph-direction 'right-to-left)
#  End:


[-- Attachment #2: S/MIME Cryptographic Signature --]
[-- Type: application/pkcs7-signature, Size: 3738 bytes --]

Re: RLT (hebrew) tables and org-odt-export-to-odt problems

[Uwe Brauer]

[-- Attachment #1: Type: text/plain, Size: 1542 bytes --]

>> "Jambunathan" == Jambunathan K <Jambunathan> writes:

   > Uwe 

   >> r2ltableorg.org is the org file and displays the text as
   >> intended. However not all of the text was written in logical order by
   >> GNU emacs, but copied from some other sources.

   > I am venturing in to the wild here and it will take multiple iterations
   > for me to even get a "feel" for what needs to be happen.  I am not even
   > sure what is right or wrong here.  Anyways...


Hi 

I tried to analyze the unzipped odt files, either generated by the
exporter or by OO. It seems to me that odt, does not support that within
*one* table, one can have one row R2L and the other L2L, but I am
not sure. If this were the case, maybe OO inserts  one row visual not
logical?



So the following simple function[1] does reverse one row of a table in
org-mode and then the export function works as expected.

hten (defun my-org-table-reverse-cells-in-row ()
  "Simple function to reverse cells in one row. This might be useful in tables with R2L and L2R text."
  (interactive)
  (save-excursion
	(newline 1)
	(end-of-line 1)
	(newline 1)
	(goto-char (org-table-begin))
	(org-table-transpose-table-at-point)
	(let*	  ((beg (org-table-begin))
			   (end (org-table-end)))
	  (goto-char beg)
	  (reverse-region beg end))
	(org-table-transpose-table-at-point)
	(kill-line nil)
	(goto-char (org-table-begin))
	(previous-line 1)
	(kill-line nil)))


Uwe 

Footnotes:
[1]  thanks to Michael Brand for the main idea.


[-- Attachment #2: smime.p7s --]
[-- Type: application/pkcs7-signature, Size: 5556 bytes --]