CEDET / Semantic should use xref-push-marker-stack when jumping to a tag, this makes it easy to pop back to the original place. Patch for Emacs 25.0.95 is attached - but maybe there are more places that need fixing? There's also the option to put this in semantic-go-to-tag directly.