Fixing this should be just a matter of changing line 890 of vc-git.el:

(grep-expand-template "git grep -n -e <R> -- <F>" regexp files))

To:

(grep-expand-template "git grep --no-color -n -e <R> -- <F>" regexp files))

Generally --no-color is used, so I can't see any similar issues elsewhere.