Robots Meta Tag Generator

Robots meta tags vs robots.txt

The <meta name="robots"> tag tells search engine crawlers how to handle a specific page. Unlike robots.txt (which controls crawling), meta robots tags control indexing and snippet behaviour — they are read after the page is fetched. Use noindex to remove a page from search results, and nofollow to prevent link equity from passing to external links. You can also target individual bots like googlebot or bingbot.

For whole-site crawl rules, use the Robots.txt Generator. For HTTP security headers, see the Security Header Generator.