all messages for Emacs-related lists mirrored at yhetil.org
 help / color / mirror / code / Atom feed
* Unicode characters display issue
@ 2023-07-02 10:22 Thanos Apollo
  2023-07-02 11:51 ` Eli Zaretskii
  0 siblings, 1 reply; 4+ messages in thread
From: Thanos Apollo @ 2023-07-02 10:22 UTC (permalink / raw)
  To: emacs-devel


I'm a medical student with little to no programming
experience/knowledge, apologies if this email is improperly formatted.

I just have an issue with a package I'm working on. It's used to scrape
video search engines like youtube, watch & download videos etc from
Emacs.

https://git.sr.ht/~thanosapollo/yeetube.el


My issue is when using 'url-retrieve-synchronously', creates a buffer
that does not automatically "transform" unicode characters. If you
copy-paste them into a browser everything is fine. Is this supposed to
be the default behavior? Am I doing something wrong?

Is the only way to fix this issue to use something like
'toggle-enable-multibyte-characters'?


-- 
Thanos
https://thanosapollo.com



^ permalink raw reply	[flat|nested] 4+ messages in thread

* Re: Unicode characters display issue
  2023-07-02 10:22 Unicode characters display issue Thanos Apollo
@ 2023-07-02 11:51 ` Eli Zaretskii
  2023-07-02 11:53   ` Thanos Apollo
  0 siblings, 1 reply; 4+ messages in thread
From: Eli Zaretskii @ 2023-07-02 11:51 UTC (permalink / raw)
  To: Thanos Apollo; +Cc: emacs-devel

> From: Thanos Apollo <public@thanosapollo.com>
> Date: Sun, 02 Jul 2023 13:22:33 +0300
> 
> 
> I'm a medical student with little to no programming
> experience/knowledge, apologies if this email is improperly formatted.
> 
> I just have an issue with a package I'm working on. It's used to scrape
> video search engines like youtube, watch & download videos etc from
> Emacs.
> 
> https://git.sr.ht/~thanosapollo/yeetube.el
> 
> 
> My issue is when using 'url-retrieve-synchronously', creates a buffer
> that does not automatically "transform" unicode characters. If you
> copy-paste them into a browser everything is fine. Is this supposed to
> be the default behavior? Am I doing something wrong?
> 
> Is the only way to fix this issue to use something like
> 'toggle-enable-multibyte-characters'?

It's hard to answer your questions without knowing what you did,
exactly.  Can you come up with a simplified Lisp program that behaves
like you describe, so that we could study it and see what you are
doing wrong?



^ permalink raw reply	[flat|nested] 4+ messages in thread

* Re: Unicode characters display issue
  2023-07-02 11:51 ` Eli Zaretskii
@ 2023-07-02 11:53   ` Thanos Apollo
  2023-07-02 12:25     ` Eli Zaretskii
  0 siblings, 1 reply; 4+ messages in thread
From: Thanos Apollo @ 2023-07-02 11:53 UTC (permalink / raw)
  To: Eli Zaretskii; +Cc: emacs-devel


Eli Zaretskii <eliz@gnu.org> writes:

> It's hard to answer your questions without knowing what you did,
> exactly.  Can you come up with a simplified Lisp program that behaves
> like you describe, so that we could study it and see what you are
> doing wrong?

Thanks for the reply!

``` 
(switch-to-buffer (url-retrieve-synchronously
"https://www.youtube.com/results?search_query=greece+survivor" t t))
```

After evaluating the above code and searching forward for "videoid"
you will be presented with unicode character sequences.


-- 
Thanos
https://thanosapollo.com



^ permalink raw reply	[flat|nested] 4+ messages in thread

* Re: Unicode characters display issue
  2023-07-02 11:53   ` Thanos Apollo
@ 2023-07-02 12:25     ` Eli Zaretskii
  0 siblings, 0 replies; 4+ messages in thread
From: Eli Zaretskii @ 2023-07-02 12:25 UTC (permalink / raw)
  To: Thanos Apollo; +Cc: emacs-devel

> From: Thanos Apollo <public@thanosapollo.com>
> Cc: emacs-devel@gnu.org
> Date: Sun, 02 Jul 2023 14:53:59 +0300
> 
> 
> Eli Zaretskii <eliz@gnu.org> writes:
> 
> > It's hard to answer your questions without knowing what you did,
> > exactly.  Can you come up with a simplified Lisp program that behaves
> > like you describe, so that we could study it and see what you are
> > doing wrong?
> 
> Thanks for the reply!
> 
> ``` 
> (switch-to-buffer (url-retrieve-synchronously
> "https://www.youtube.com/results?search_query=greece+survivor" t t))
> ```
> 
> After evaluating the above code and searching forward for "videoid"
> you will be presented with unicode character sequences.

This is a unibyte buffer: "M-: enable-multibyte-characters RET"
reports nil.  So what you see are raw bytes of the encoded text.  You
need to decode it, e.g., by using decode-coding-region.  The header
says "Content-Type: text/html; charset=utf-8", so the coding-system to
use in decoding is utf-8.  For example:

  (decode-coding-region (point-min) (point-max) 'utf-8
                        (get-buffer-create "decoded"))



^ permalink raw reply	[flat|nested] 4+ messages in thread

end of thread, other threads:[~2023-07-02 12:25 UTC | newest]

Thread overview: 4+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2023-07-02 10:22 Unicode characters display issue Thanos Apollo
2023-07-02 11:51 ` Eli Zaretskii
2023-07-02 11:53   ` Thanos Apollo
2023-07-02 12:25     ` Eli Zaretskii

Code repositories for project(s) associated with this external index

	https://git.savannah.gnu.org/cgit/emacs.git
	https://git.savannah.gnu.org/cgit/emacs/org-mode.git

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.