> In what sense does the use of `with-temp-buffer' "handle" this issue?
> New buffers copy the default directory from the current buffer, and I
> don't see any code in `with-temp-buffer' to ensure the default
> directory exists.

Silly me.  Would the attached do it?