Skip to content
Site Audit API
PricingNetworkDocsPlaygroundFree tools
Dashboard Get started
PricingNetworkDocsPlaygroundFree toolsDashboardGuidesFAQ Get started

Company

  • About
  • Data sources
  • Changelog
  • Security
  • FAQ
  • Contact
Home / Data sources

Data sources

Where every number in a report comes from. Each report also lists its own sources, with the time each file was fetched.

Current data mode on this server: First-party crawl (site). Calls served in the last 30 days: 0, all by this one source. There is no automatic failover to a second source.

SourceKindUsed forStatus
The audited sitefirst-partyPages (15 sampled by default), headers, links, redirectsAlways
robots.txt and XML sitemapsfirst-partyCrawl rules, URL inventory, sitemap errorsAlways
Competitors' robots.txt, sitemaps and homepagepublicTopic and section gaps, inventory size, homepage tagsWhen you pass competitors
Google PageSpeed Insightsthird-party, freeLighthouse score, LCP, field data for the homepageOff on this server
Licensed SEO datathird-party, licensedKeyword volumes, rankings, backlinksNot configured

How the crawler behaves

  • Identifies itself as SiteAuditBot in the User-Agent.
  • Fetches the homepage you submit, then honours robots.txt for everything else (a 404 robots.txt means allowed, a 5xx means disallowed).
  • At most a few dozen requests per audit, 4 in parallel, within a 60-second budget and 2 MB per page.
  • Only public IP addresses are fetched; redirects are re-checked at every hop.
  • Competitors are only touched through robots.txt, sitemaps and the homepage.

Only audit sites you own or are authorised to audit (see the Acceptable Use Policy). To block the crawler, add a User-agent: SiteAuditBot group with Disallow: /.

What we never use

No scraped search-engine result pages, no logged-in sessions, no personal data sources.

Product

  • Pricing
  • Endpoints
  • Playground
  • Dashboard
  • Network

Free tools

  • All free tools
  • Title & description checker
  • robots.txt tester
  • Sitemap validator
  • hreflang checker
  • Heading outline
  • Structured data checker
  • Social preview
  • Indexability checker

Learn

  • Guides
  • Check reference
  • Use cases
  • Compare
  • Glossary

Developers

  • Docs
  • Quickstart
  • MCP server
  • Agent guide
  • llms.txt
  • OpenAPI

Company

  • About
  • FAQ
  • Changelog
  • Data sources
  • Contact
  • Security

Legal

  • Terms of Service
  • Privacy Policy
  • Refund Policy
  • Acceptable Use
  • Data Processing
Site Audit API © 2026 Mohamed Outerbah · justshipit00@gmail.com