From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Gregory Heytings Newsgroups: gmane.emacs.bugs Subject: bug#46933: Possible bugs in filepos-to-bufferpos / bufferpos-to-filepos Date: Thu, 04 Mar 2021 21:21:24 +0000 Message-ID: <9cff0f8894f167925251@heytings.org> Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="QDJK79UVpA" Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="14910"; mail-complaints-to="usenet@ciao.gmane.io" To: 46933@debbugs.gnu.org Original-X-From: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Thu Mar 04 22:22:13 2021 Return-path: Envelope-to: geb-bug-gnu-emacs@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1lHvQA-0003ef-MY for geb-bug-gnu-emacs@m.gmane-mx.org; Thu, 04 Mar 2021 22:22:11 +0100 Original-Received: from localhost ([::1]:40322 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1lHvQ9-0000cU-PE for geb-bug-gnu-emacs@m.gmane-mx.org; Thu, 04 Mar 2021 16:22:09 -0500 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]:43732) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lHvQ2-0000ab-Ki for bug-gnu-emacs@gnu.org; Thu, 04 Mar 2021 16:22:02 -0500 Original-Received: from debbugs.gnu.org ([209.51.188.43]:48943) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1lHvQ2-0000DV-Dg for bug-gnu-emacs@gnu.org; Thu, 04 Mar 2021 16:22:02 -0500 Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1lHvQ2-0008Ju-9D for bug-gnu-emacs@gnu.org; Thu, 04 Mar 2021 16:22:02 -0500 X-Loop: help-debbugs@gnu.org Resent-From: Gregory Heytings Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Thu, 04 Mar 2021 21:22:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: report 46933 X-GNU-PR-Package: emacs X-Debbugs-Original-To: bug-gnu-emacs@gnu.org Original-Received: via spool by submit@debbugs.gnu.org id=B.161489289231945 (code B ref -1); Thu, 04 Mar 2021 21:22:02 +0000 Original-Received: (at submit) by debbugs.gnu.org; 4 Mar 2021 21:21:32 +0000 Original-Received: from localhost ([127.0.0.1]:60489 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lHvPX-0008JB-Tb for submit@debbugs.gnu.org; Thu, 04 Mar 2021 16:21:32 -0500 Original-Received: from lists.gnu.org ([209.51.188.17]:41820) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lHvPW-0008J2-1e for submit@debbugs.gnu.org; Thu, 04 Mar 2021 16:21:31 -0500 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]:43582) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lHvPV-0000WI-RV for bug-gnu-emacs@gnu.org; Thu, 04 Mar 2021 16:21:29 -0500 Original-Received: from heytings.org ([95.142.160.155]:47266) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lHvPT-0008Nf-2X for bug-gnu-emacs@gnu.org; Thu, 04 Mar 2021 16:21:29 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=heytings.org; s=20210101; t=1614892884; bh=Jmbob/yJrwyZ1+lBsya86DOUtTywDHjqRbL4Pqx5j/8=; h=Date:From:To:Subject:Message-ID:From; b=IqxV3FFit6BBwATkZUDvGmZqFrFHjnUTP3vMALHNfEqRq02GHn44x0oJWFNeJaspq /8Badudrm0NW+g8pX/QKwrqMG1bRsg5jK5bJPwlDufneEPs4xsdnsCZ8I1MYUG9dyT TACUOB0yHE/cqRnN7kO4XUN+WAQFLkwuLXEeOxQR/fZl+Ue0xUx3bfodYEWqhdH/zN NLPpB+J6aw80sKt3Xxn1ktNIvcMr/jAgI9XV4ANPa4w6rVdjXWYdntnmq4bDXY2O8E NbyYBdJKqDibNauZXgtMUQer2qHGISsTn+K5Dz9fy+1VMo/0xfX7aGBaEQMcmJ8Mvy V48eA55xmO2Tw== Received-SPF: pass client-ip=95.142.160.155; envelope-from=gregory@heytings.org; helo=heytings.org X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-gnu-emacs@gnu.org List-Id: "Bug reports for GNU Emacs, the Swiss army knife of text editors" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Original-Sender: "bug-gnu-emacs" Xref: news.gmane.io gmane.emacs.bugs:201474 Archived-At: --QDJK79UVpA Content-Type: text/plain; format=flowed; charset=us-ascii (Disclaimer: I have no knowledge whatsoever about the ISO-2022-JP encoding, and although this looks like a bug, I'm not sure this is actually a bug; I report this at the suggesion of Eli in bug#46859.) I downloaded the file [1], and converted it to the ISO-2022-JP encoding with iconv -t iso-2022-jp one.txt > iso-2022-jp.txt. The resulting file is attached to this bug report. It ends with two CRLFs, at byte offsets 2993 and 2995. However, after emacs -Q iso-2022-jp.txt, with M-: (goto-char (filepos-to-bufferpos POS 'exact)) we get: POS = 2991, 2992: last but one visible character (HIRAGANA LETTER RU) POS = 2993, 2994: last visible character (IDEOGRAPHIC FULL STOP) POS = 2995, 2996: first CRLF POS = 2997: second CRLF POS = 2998: point-max POS = 2999: first CRLF POS = 3000, 3001: second CRLF POS >= 3002: point-max I would have expected: POS = 2989, 2990: last but one visible character (HIRAGANA LETTER RU) POS = 2991, 2992: last visible character (IDEOGRAPHIC FULL STOP) POS = 2993, 2994: first CRLF POS = 2995, 2996: second CRLF POS >= 2997: point-max The opposite operation M-: (bufferpos-to-filepos (- (point) POS) 'exact) apparently also has bugs; its return values are not coherent with the above ones: POS = 0: 3003 POS = 1: 3001 POS = 2: 2999 POS = 3 (IDEOGRAPHIC FULL STOP): 2997 POS = 4 (HIRAGANA LETTER RU): 2995 I would have expected: POS = 0: 2997 POS = 1: 2995 POS = 2: 2993 POS = 3 (IDEOGRAPHIC FULL STOP): 2991 POS = 4 (HIRAGANA LETTER RU): 2989 [1] https://darza.com/ecbackend/vendor/symfony/mime/Tests/Fixtures/samples/charsets/iso-2022-jp/one.txt In GNU Emacs 27.1 (build 1, x86_64-pc-linux-gnu, GTK+ Version 3.24.23, cairo version 1.16.0) of 2020-11-08, modified by Debian built on x86-ubc-01 Windowing system distributor 'The X.Org Foundation', version 11.0.12010000 System Description: Debian GNU/Linux bullseye/sid Configured using: 'configure --build x86_64-linux-gnu --prefix=/usr --sharedstatedir=/var/lib --libexecdir=/usr/lib --localstatedir=/var/lib --infodir=/usr/share/info --mandir=/usr/share/man --enable-libsystemd --with-pop=yes --enable-locallisppath=/etc/emacs:/usr/local/share/emacs/27.1/site-lisp:/usr/local/share/emacs/site-lisp:/usr/share/emacs/27.1/site-lisp:/usr/share/emacs/site-lisp --with-sound=alsa --without-gconf --with-mailutils --build x86_64-linux-gnu --prefix=/usr --sharedstatedir=/var/lib --libexecdir=/usr/lib --localstatedir=/var/lib --infodir=/usr/share/info --mandir=/usr/share/man --enable-libsystemd --with-pop=yes --enable-locallisppath=/etc/emacs:/usr/local/share/emacs/27.1/site-lisp:/usr/local/share/emacs/site-lisp:/usr/share/emacs/27.1/site-lisp:/usr/share/emacs/site-lisp --with-sound=alsa --without-gconf --with-mailutils --with-cairo --with-x=yes --with-x-toolkit=gtk3 --with-toolkit-scroll-bars 'CFLAGS=-g -O2 -fdebug-prefix-map=/build/emacs-6jKC2B/emacs-27.1+1=. -fstack-protector-strong -Wformat -Werror=format-security -Wall' 'CPPFLAGS=-Wdate-time -D_FORTIFY_SOURCE=2' LDFLAGS=-Wl,-z,relro' Configured features: XPM JPEG TIFF GIF PNG RSVG CAIRO SOUND GPM DBUS GSETTINGS GLIB NOTIFY INOTIFY ACL LIBSELINUX GNUTLS LIBXML2 FREETYPE HARFBUZZ M17N_FLT LIBOTF ZLIB TOOLKIT_SCROLL_BARS GTK3 X11 XDBE XIM MODULES THREADS LIBSYSTEMD JSON PDUMPER LCMS2 GMP Important settings: value of $LANG: en_US.UTF-8 locale-coding-system: utf-8-unix Major mode: Lisp Interaction Minor modes in effect: tooltip-mode: t global-eldoc-mode: t eldoc-mode: t electric-indent-mode: t mouse-wheel-mode: t tool-bar-mode: t menu-bar-mode: t file-name-shadow-mode: t global-font-lock-mode: t font-lock-mode: t blink-cursor-mode: t auto-composition-mode: t auto-encryption-mode: t auto-compression-mode: t line-number-mode: t transient-mark-mode: t Load-path shadows: None found. Features: (shadow sort mail-extr emacsbug message rmc puny dired dired-loaddefs format-spec rfc822 mml easymenu mml-sec password-cache epa derived epg epg-config gnus-util rmail rmail-loaddefs text-property-search time-date subr-x seq byte-opt gv bytecomp byte-compile cconv mm-decode mm-bodies mm-encode mail-parse rfc2231 mailabbrev gmm-utils mailheader cl-loaddefs cl-lib sendmail rfc2047 rfc2045 ietf-drums mm-util mail-prsvr mail-utils tooltip eldoc electric uniquify ediff-hook vc-hooks lisp-float-type mwheel term/x-win x-win term/common-win x-dnd tool-bar dnd fontset image regexp-opt fringe tabulated-list replace newcomment text-mode elisp-mode lisp-mode prog-mode register page tab-bar menu-bar rfn-eshadow isearch timer select scroll-bar mouse jit-lock font-lock syntax facemenu font-core term/tty-colors frame minibuffer cl-generic cham georgian utf-8-lang misc-lang vietnamese tibetan thai tai-viet lao korean japanese eucjp-ms cp51932 hebrew greek romanian slovak czech european ethiopic indian cyrillic chinese composite charscript charprop case-table epa-hook jka-cmpr-hook help simple abbrev obarray cl-preloaded nadvice loaddefs button faces cus-face macroexp files text-properties overlay sha1 md5 base64 format env code-pages mule custom widget hashtable-print-readable backquote threads dbusbind inotify lcms2 dynamic-setting system-font-setting font-render-setting cairo move-toolbar gtk x-toolkit x multi-tty make-network-process emacs) --QDJK79UVpA Content-Type: text/plain; name=iso-2022-jp.txt Content-Transfer-Encoding: BASE64 Content-ID: <9cff0f889484674cce7f@heytings.org> Content-Description: Content-Disposition: attachment; filename=iso-2022-jp.txt SVNPLTIwMjItSlAbJEIkTyEiJSQlcyU/ITwlTSVDJUg+ZRsoQigbJEJGQyRL RUU7UiVhITwlaxsoQikbJEIkSiRJJEc7SCRvJGwka0Z8S1wkTko4O3pNUSRO Sjg7eklkOWYyPUp9PDAhIxsoQklTTy9JRUMgMjAyMhskQiROJSglOSUxITwl VyU3ITwlMSVzJTkkck14TVEkNyRGSjg7ej04OWckckBaJGpCWCQoJGsbKEI3 GyRCJVMlQyVIJE4lMyE8JUkkRyQiJGskMyRIJHJGQ0QnJEgkOSRrGyhCICgb JEIlIiVKJSYlcyU5NSFHPSROJSglOSUxITwlVyU3ITwlMSVzJTkkTz5KTiwk NSRsJGsbKEIpGyRCISNCLyRLIVYbKEJKSVMbJEIlMyE8JUkhVyRIOEYkUCRs JGskMyRIJGIkIiRrISMbKEINCg0KGyRCMzVNVxsoQg0KGyRCRnxLXDhsST01 LSRYJE5NeE1RJCxBW0RqJDUkbCRGJCQka0o4O3olMyE8JUkkRyQiJGohIkZ8 S1w4bCROTXhNUSQ1JGwkayVNJUMlSCVvITwlLyRLJCokJCRGISJGfEtcJE41 LDNKJHIxfk1RJDckPyRiJE4kRyQiJGshIyReJD9KODt6PTg5ZyRIJDckRiRP ISJGfEtcOGwkR01RJCQkaSRsJGs0QTt6ISIkUiRpJCwkSiEiJSslPyUrJUok TyRiJEEkbSRzISIlaSVGJXNKODt6ISIlLiVqJTclIko4O3ohIiUtJWola0o4 O3okSiRJJGI0XiRzJEckKiRqISIzWD1RJGQ7OjZIJE5KLExuJEckTk14TVEk YjlNTjgkPyRiJE4kSCRKJEMkRiQkJGshIzUsM0pMPiRLISIbKEJJU08bJEIk TkZ8S1w4bCROOEA4bCUzITwlSSRHJCIkaxsoQmphGyRCJEckTyRKJC8hIjlx ISZDTzBoTD4lMyE8JUkkThsoQkpQGyRCJCw8KCQ1JGwkRiQkJGskZiQoJHMk RyQiJGshIxsoQg0KGyRCSjg7ej04OWckSCQ3JEYbKEJKSVMgWCAwMjAxGyRC JE4bKEJDMBskQj04OWchSkApOGZKODt6IUshIhsoQkpJUyBYIDAyMDEbJEIk TiVpJUYlc0o4O3o9ODlnISIbKEJJU08gNjQ2GyRCJE45cTpdNHA9YEhHP143 QUo4O3ohIhsoQkpJUyBYIDAyMDgbJEIkThsoQjE5NzgbJEJHL0hHIUobKEJK SVMgQyA2MjI2LTE5NzgbJEIhSyRIGyhCMTk4MxskQkcvJCokaCRTGyhCMTk5 MBskQkcvSEckLE14TVEkRyQtJGshIxsoQkpJUyBYIDAyMDEbJEIkTkpSMj5M Pko4O3o9ODlnJE9NeE1RJEckLSRKJCQhIxsoQjE5ODYbJEJHLzBKOV8hIkZ8 S1wkTkVFO1IlYSE8JWskR01RJCQkaSRsJEYkLSQ/GyhCSlVORVQbJEIlMyE8 JUkkciEiQjwwZj1jISYbKEJNYXJrIENyaXNwaW4bJEIhJhsoQkVyaWsgdmFu IGRlciBQb2VsGyRCJCwbKEIxOTkzGyRCRy8kSxsoQlJGQxskQjI9JDckPyRi JE4bKEIoUkZDIDE0NjgpGyRCISM4ZSRLGyhCSklTIFggMDIwODoxOTk3GyRC JE5JbUIwPXEbKEIyGyRCJEgkNyRGGyhCSklTGyRCJEs1LERqJDUkbCQ/ISMb KEJNSU1FGyRCJEskKiQxJGtKODt6SWQ5ZjI9Sn08MCROPDFKTE1RJE5MPkEw JEgkNyRGGyhCIElBTkEgGyRCJEtFUE8/JDUkbCRGJCQkayEjGyhCDQobJEIk SiQqISJJZDlmMj0kTjtFTU0kSyREJCQkRiRPGyhCSVNPL0lFQyAyMDIyI0lT Ty0yMDIyLUpQGyRCJGI7Mj5IISMbKEINCg0KSVNPLTIwMjItSlAbJEIkSEhz STg9YEUqM0hEJTtITVEbKEINChskQiFWGyhCSklTGyRCJTMhPCVJIVchSiRe JD8kTyFWGyhCSVNPLTIwMjItSlAbJEIhVyFLJEgkJCQmJTMhPCVJTD4kTjUs RGoyPCRHJE8hIiQ9JE47RU1NREwkaiROO0hNUSQsNWEkYSRpJGwkayEjJDck KyQ3ISIbKEJXaW5kb3dzIE9TGyRCPmUkRyRPISI8QjpdJEskTxsoQkNQOTMy GyRCJTMhPCVJGyhCIChNaWNyb3NvZnQbJEIkSyRoJGsbKEJTaGlmdCBKSVMb JEIkcjNIRCUkNyQ/MCE8byEjGyhCSVNPLTIwMjItSlAbJEI1LERqMzBKODt6 JCxESTJDJDUkbCRGJCQkayEjIUskSyRoJGtGSDwrM0hEJSFKJE5KODt6IUsk ckNHJGokSiQvO0gkJiUiJVclaiUxITwlNyVnJXMkLEI/JCQhIyQzJE5OYyRI JDckRhsoQkludGVybmV0IEV4cGxvcmVyGyRCJGQbKEJPdXRsb29rIEV4cHJl c3MbJEIkLCQiJGshIyReJD8hIhsoQkVtRWRpdG9yGyRCISI9KDRdJSglRyUj JT8kZBsoQlRodW5kZXJiaXJkGyRCJE4kaCQmJEobKEJNaWNyb3NvZnQbJEI8 UjBKMzAkThsoQldpbmRvd3MbJEIlIiVXJWolMSE8JTclZyVzJEckYkYxTU0k Tj5sOWckLCQiJGshIyQzJE4+bDlnISIbKEJJU08tMjAyMi1KUBskQiROSE8w TzMwJE5KODt6JHI7SCRDJEYkNyReJCYkSCEiMFskSiRrQD1JSjRWJEckT0wk RGo1QUlUTEBKODt6JEgkNyRGRyc8MSQ1JGwkayQrISIkYiQ3JC8kT0o4O3oy PSQxJHI1LyQzJDk4NjB4JEgkSiRrISMkPSROJD8kYSEiGyhCV2luZG93cxsk Qk1RJE5FRTtSJWEhPCVrJS8laSUkJSIlcyVIJEckIiRDJEYkYkZIPCszSEQl JE5KODt6JHI7SE1RJDkkayRIN1k5cCRyPVAkNyQ/JGohIiQiJCgkRjtIJCgk SiQkJGgkJiRLQCk4QiQ3JEYkJCRrJGIkTiRiQjg6XyQ5JGshIyQ1JGkkSyRP GyhCSVNPLTIwMjItSlAbJEIkTkhPME9GYiRHJCIkQyRGJGIbKEJDUDkzMhsk QiRPSHNJOD1gSjg7eiFKGyhCRlVMTFdJRFRIIFRJTERFGyRCRXkhSyRyO30k RCROJEdKODt6Mj0kMSROODYweCRLJEokakZAJGshIxsoQg0KGyRCJF4kPyEi SWQ5ZjI9Sn08MEw+JHIbKEJJU08tMjAyMi1KUBskQiRIJDckRiQkJGskTiRL ISJKODt6PTg5ZyRIJDckRiRPGyhCSklTIFggMDIxMiAoGyRCJCQkbyRmJGtK ZD11NEE7ehsoQikgGyRCJGQbKEJKSVMgWCAwMjAxGyRCJE5KUjI+TD5KODt6 PTg5ZxsoQiAoGyRCJCQkbyRmJGtIPjNRJSslShsoQikgGyRCJHIkYklkOWYy PSQ3JEYkJCRrTmMkLCQiJGskLCEiGyhCSVNPLTIwMjItSlAbJEIkRyRPJDMk bCRpJE5KODt6JHI1dk1GJDckRiQkJEokJCEjJDMkbCRpJE5JZDlmMj0kT0ZI PCszSEQlJE48QkF1JEckIiRqISJDZiRLJE8bKEJJU08vSUVDIDIwMjIbJEIk TjtFTU0kSz1gNXIkOSRpJDckRiQkJEokJCRiJE4kYiQiJGsbKEJbMl0bJEIh Iz0+JEMkRjx1Py5CJiRORUU7UiVhITwlayUvJWklJCUiJXMlSCQsJDMkbCRp JE5GSDwrM0hEJSRLQlAxfiQ3JEYkJCRKJCQ+bDlnISIkPSROSjg7eiQiJGsk JCRPJD0kTko4O3okcjReJGA5VCEiO34kSyRPJUYlLSU5JUhBNEJOJCxKODt6 Mj0kMSQ5JGskMyRIJCwkIiRrISMbKEINCg0K --QDJK79UVpA--