Free tools

Indexability checker (robots meta and canonical)

Paste a page's head and optional X-Robots-Tag header to see whether it may be indexed and where its canonical points. Runs in your browser; nothing you paste leaves this page.

How to use it

  1. Enter the exact URL you are checking, including parameters.
  2. If the server sends an X-Robots-Tag header, paste its value (browser network panel, response headers).
  3. Paste the <head> and press Check.

What it covers

Accepts

A page URL, an optional X-Robots-Tag value and the HTML head.

Returns

Whether a noindex/none directive applies, nofollow, canonical presence, count, host and conflicts.

Stops at

robots.txt (use the robots.txt tester) and redirects, which need a live request.

Questions

Does robots.txt affect indexing?

It controls fetching. A page blocked in robots.txt can still appear in results without a snippet, and its noindex is never seen.

Is a canonical a directive?

No, it is a strong hint. noindex is a directive.

Check a whole site in one call

The audit endpoint runs this kind of check across sampled pages of a site, with the evidence URLs. Related checks: Pages marked noindex, No canonical tag, Canonical points to another domain.

More free tools