Adding this line to your  ~/.inputrc provides this functionality, even with vi-mode enabled.

This bug could be closed, perhaps with a documentation note somewhere.