Skip to content
GetAllAPIs
APIsPricingNetworkDocsPlaygroundFree tools
Dashboard Get started
APIsPricingNetworkDocsPlaygroundFree toolsDashboardGuidesFAQ Get started

Guides

  • Audit a website from an AI agent over MCP
  • How to read an audit report
  • Find competitor topic gaps from public sitemaps
  • robots.txt, noindex or canonical: which one to use
  • SEO checks before and after a site migration
  • Fix broken internal links and redirect chains
Home / Guides / Find competitor topic gaps from public sitemaps

Find competitor topic gaps from public sitemaps

Updated 2026-11-17

Most keyword-gap tools start from a database of rankings. The free mode of seo.keyword_gap starts from something every site publishes for crawlers: its sitemap.

The method

  1. Read robots.txt on both sites, follow declared sitemaps (including sitemap indexes and gzip files) and collect the URLs.
  2. Split each path into sections (the first folder, such as /integrations/) and topic phrases taken from the slug.
  3. Drop boilerplate sections (login, cart, tags, authors, legal and similar).
  4. Report section gaps: whole folders only the competitor has, with URL counts and examples.
  5. Report topic gaps: phrases the competitor has a page for that no crawled page or sitemap URL on your site mentions.

What it is good at

  • Spotting page types you do not have at all: comparison pages, integration pages, templates, location pages, glossaries.
  • Seeing how big a competitor's content program is, and where it is concentrated.
  • Working on any site with a public sitemap, at no data cost.

What it cannot tell you

  • Demand. A competitor page is evidence that someone thought the topic mattered, not that people search for it. Validate before writing.
  • Rankings. We do not know which of their pages bring traffic.
  • Sites without sitemaps, or with slugs that are IDs instead of words, give little to compare. The report says so in its notes.

With a licensed keyword source configured, the same endpoint switches to ranked keywords (method: "ranked_keywords") and the output gains volumes and positions.

A practical workflow

Run the gap against two or three competitors. Collect section gaps that appear for more than one of them; those are page types your market expects. Pick the ones that match a real customer question, write one strong page per topic, and link it from a relevant existing page.

Run the full audit on your site. One call checks every item in the check reference and ranks the fixes.

Open the playground Endpoint details

Product

  • API catalog
  • Pricing
  • Site audit
  • Playground
  • Dashboard
  • Network

Free tools

  • All free tools
  • Title & description checker
  • robots.txt tester
  • Sitemap validator
  • hreflang checker
  • Heading outline
  • Structured data checker
  • Social preview
  • Indexability checker

Learn

  • Guides
  • Check reference
  • Use cases
  • Compare
  • Glossary

Developers

  • Docs
  • Quickstart
  • MCP server
  • Agent guide
  • llms.txt
  • OpenAPI

Company

  • About
  • FAQ
  • Changelog
  • Data sources
  • Contact
  • Security

Legal

  • Terms of Service
  • Privacy Policy
  • Refund Policy
  • Acceptable Use
  • Data Processing
GetAllAPIs © 2026 Mohamed Outerbah · [email protected]