> No, non-existing PATH elements are supposed to be ignored.

Ok, let me rephrase this.

Non-existent PATH element are ignored when searching, if the program is found.

When the search fails, Emacs is now reporting "permission denied" if some PATH element was non-existent, or "no such file or directory" otherwise. At least on Windows.