Re: Multimedia dashboard in GNU Emacs

[Aiko Kyle <aikokyle@gmail.com>]

On Thu, Dec 30, 2021 at 5:59 PM Po Lu <luangruo@yahoo.com> wrote:
>
> Aiko Kyle <aikokyle@gmail.com> writes:
>
> > As I see. So in this idea, the entire webpage would be rendered in the
> > case of a xwidget webkit? That seems like it would be costly for
> > especially large webpages.
>
> WebKit in general tends to choke on large webpages, so I'm not too
> worried.
>

Are you actually thinking about implementing this idea?

> > Do you then plan on implementing other xwidget types besides the
> > webkit one? I think with respect to the UI, osr makes more sense for
> > other widget types like buttons.
>
> Yes, there will be a GStreamer widget: it will use multiple video sinks
> connected to a single tee, allowing for a source to be displayed in
> multiple windows without offscreen rendering.
>

I'll be interested to see how that integrates with the existing xwidget code.

> > I agree the offscreen rendering is more general, however it seems to
> > me to add significant complexity that would be unnecessary if the UI
> > for it doesn't require it. Especially since the one-to-one webkit
> > buffer-window paradigm already has to be accounted for on ns, where
> > osr isn't available.
>
> I consider that a bug, but I don't know enough about NS development to
> fix it.

According to the author of nsxwidget.m and their comment at the top of
the file, it's maybe not technically possible. I think rendering to
offscreen surfaces probably breaks assumptions the webkit developers
make, and the situation will likely only get worse as browsers are
increasingly hardware accelerated.