So reproducing this requires the development version of Org?

Yes.

I cannot reproduce with the version of Org we have on the Emacs
master branch.

I cannot reproduce on stable branch either. Only on main.

Best,

Ihor