Find competitor topic gaps from public sitemaps
Updated 2026-11-17
Most keyword-gap tools start from a database of rankings. The free mode of seo.keyword_gap starts from something every site publishes for crawlers: its sitemap.
The method
- Read robots.txt on both sites, follow declared sitemaps (including sitemap indexes and gzip files) and collect the URLs.
- Split each path into sections (the first folder, such as
/integrations/) and topic phrases taken from the slug. - Drop boilerplate sections (login, cart, tags, authors, legal and similar).
- Report section gaps: whole folders only the competitor has, with URL counts and examples.
- Report topic gaps: phrases the competitor has a page for that no crawled page or sitemap URL on your site mentions.
What it is good at
- Spotting page types you do not have at all: comparison pages, integration pages, templates, location pages, glossaries.
- Seeing how big a competitor's content program is, and where it is concentrated.
- Working on any site with a public sitemap, at no data cost.
What it cannot tell you
- Demand. A competitor page is evidence that someone thought the topic mattered, not that people search for it. Validate before writing.
- Rankings. We do not know which of their pages bring traffic.
- Sites without sitemaps, or with slugs that are IDs instead of words, give little to compare. The report says so in its notes.
With a licensed keyword source configured, the same endpoint switches to ranked keywords (method: "ranked_keywords") and the output gains volumes and positions.
A practical workflow
Run the gap against two or three competitors. Collect section gaps that appear for more than one of them; those are page types your market expects. Pick the ones that match a real customer question, write one strong page per topic, and link it from a relevant existing page.
Run the full audit on your site. One call checks every item in the check reference and ranks the fixes.
Open the playground Endpoint details