Meta Robots Tag & X-Robots-Tag Generator
Build precise crawling and indexing rules for Googlebot, Bingbot, and web spiders with HTML tags and HTTP headers.
About This Tool
The Meta Robots & X-Robots-Tag Generator creates standard HTML `<meta name='robots'>` tags and server-level HTTP `X-Robots-Tag` response headers. Control crawling, indexing, snippet lengths, image previews, and caching archives across your website.
How to Use This Tool
- Toggle crawling and indexing directives (noindex, nofollow, noarchive, nosnippet, noimageindex).
- Configure Google snippet limits (max-snippet, max-image-preview, max-video-preview).
- Copy the HTML `<meta>` tag for individual page templates or the HTTP header for Nginx/Apache.
- Deploy to your staging or production environment.
Why Use This Tool
- Prevent staging, admin, or thin-content pages from appearing in Google search results.
- Generate valid Apache Header and Nginx add_header directives.
- Optimize Google Discover eligibility with `max-image-preview:large`.
- 100% instant and private.
Frequently Asked Questions
What is the difference between meta robots and X-Robots-Tag?
Meta robots is an HTML tag placed in the `<head>` of HTML files, while X-Robots-Tag is an HTTP response header that can control indexing on non-HTML files like PDFs, images, and API endpoints.
Why should I use max-image-preview:large?
Google requires `max-image-preview:large` to display large visual thumbnail cards in Google Discover and Google Search.
Related Tools
SSL / X.509 Certificate Inspector
Inspect and decode PEM / CRT SSL certificates to view Common Name, Issuer, SANs, and Expiry.
CRC32 Checksum Calculator
Compute standard 32-bit CRC32 checksums (IEEE 802.3) in Hexadecimal, Decimal, and Binary.
FAQ Page JSON-LD Schema Generator
Build interactive FAQPage JSON-LD structured data for Google Search rich snippets.