SEO glossary · Crawling and indexing

What is an XML sitemap?

An XML sitemap is a file that lists the URLs a site wants search engines to crawl, with an optional last-modified date for each. The format is the sitemaps.org protocol, which Google, Yahoo and Microsoft adopted jointly in November 2006. A sitemap helps discovery; it does not guarantee that a URL is indexed.

What are the limits of a sitemap file?

One sitemap file may hold up to 50,000 URLs and be up to 50 MB uncompressed. A larger site splits its URLs across several files and lists those files in a sitemap index. Every URL must be absolute and on the host the sitemap is served from.

Which sitemap tags does Google use?

Google uses <loc> and, when it proves consistently accurate, <lastmod>. Google ignores <priority> and <changefreq>. A lastmod date should change only when the page's main content, structured data or links change, not on every build.

Which pages belong in a sitemap?

  • Canonical URLs that answer 200.
  • Pages that may be indexed: no noindex, no robots.txt block.
  • Not redirects, error pages, duplicates or pages with tracking parameters.

How is a sitemap submitted?

Add a Sitemap line with the full address to robots.txt, and submit the sitemap in Google Search Console and Bing Webmaster Tools. Google retired its sitemap ping endpoint in 2023, so an unauthenticated ping no longer works there. Bing and other engines accept IndexNow for instant notice of changes.

How SEOAnything helps

The SEO tools produce a starter sitemap.xml, and Search Visibility crawls a site and reports each page's status, canonical and index state. Go to Search Visibility.

Sources

Also described at Wikipedia: Sitemaps.

Related terms

  • IndexNow: IndexNow is an open protocol that tells Bing, Yandex and other search engines the moment a URL changes. How it works, who supports it, and how to set it up.
  • robots.txt: robots.txt is a text file at a site's root that tells crawlers which paths they may fetch. Its syntax, its limits, and why it cannot keep a page out of search.
  • Canonical tag: A canonical tag names the preferred address of a page that can be reached at several URLs. How search engines use it, and the mistakes that make them ignore it.
  • Crawl budget: Crawl budget is the number of URLs a search engine will crawl on a site in a given time. Google says most sites need not manage it. Who does, and what helps.

All terms in the SEO and AI search glossary

Updated 20 November 2026 · Search engines and AI platforms change their rules: check the sources above for what is true today.