Sitemaps and crawlability: helping Google find every page
The most expensive SEO problem is invisible: pages that simply never get found. How sitemaps, internal links and redirects decide what Google sees.
Google only ranks what it can reach
Before a page can rank, three quiet things have to go right: Google has to discover the URL, be allowed to crawl it, and decide to index it. Most "why is this page not ranking" mysteries are solved in step one. The page was never discovered at all.
Discovery happens through links and sitemaps. A page that no other page links to, and that your sitemap does not mention, is an island. It can be the best page on your site and still be invisible.
What a sitemap is actually for
A sitemap.xml is a guest list, and it carries no ranking power of its own. It tells crawlers "these are the pages I care about", which matters most for large catalogues, fresh content, and pages buried deep in navigation.
The classic failure mode is drift: the shop adds products, the CMS renders them, and the sitemap generator quietly stopped including them months ago. Nobody notices, because the pages work fine in the browser.
- Keep the sitemap generated automatically. One kept by hand drifts.
- Only include canonical, indexable, 200-status URLs.
- Compare the sitemap against a crawl regularly. The pages in one but not the other are your story.
Redirect chains lose crawlers halfway
Every redirect hop costs crawl budget and dilutes signals. One hop is fine. Three hops (http to https to www to the new slug) and crawlers start giving up before they arrive, especially on big sites.
The fix is boring and effective: point internal links and sitemap entries straight at the final URL, and collapse chains into a single hop. Your visitors will see no difference; your crawl stats will show one.