In practice
Segment by verified bot, by status code and by directory; the pattern that matters is where crawl attention is being spent.
Compare crawled URLs against the sitemap to find both orphan pages and pages being crawled that should not exist.
Why it matters
It is the only source that shows real crawler behaviour rather than a sampled report.
Most large-site crawl problems — parameters, infinite spaces, stale redirects — are invisible without it.
Related terms