The form Glenn suggested would place remember-data-directory under user-emacs-directory, which is documented to contain "additional per-user Emacs-specific files", not merely configuration files.
It's better to make this the default location instead of cluttering up users' home directories, especially with non-hidden files, without their permission.
See also bug 13870 for a recent precedent.