Not sure how to fix this properly but debian-ispell resets the variables I set for ispell-dictionary-alist. Really since I use hunspell I don't care about the default dictionaries at all so I'm fine with removing from startup but not sure where this occurs. Somewhere in the site startup I would have to remove debian-ispell.el but not sure where to do this.