*Obviously.*

An alternative to that is to serve a real on-disc robots.txt.

Kind regards,

T G-R