Featured guide
Start here
XML Sitemap Basics
Learn what XML sitemaps do, how they help search engines find URLs, and why sitemap inclusion does not guarantee indexing.
Guide archive
Technical SEO basics, explained clearly
Common Robots.txt Mistakes
Review common robots.txt errors that can block important pages, confuse crawlers, or create false assumptions about indexing.
Robots.txt Explained
A clear guide to robots.txt files, how crawler rules work, and what site owners should know before blocking URLs.
Crawlability vs Indexability: What’s the Difference?
Understand the difference between pages that search engines can crawl and pages that they may choose to index.
What Is Crawlability?
Learn what crawlability means, why it matters for search engines, and how a website can make important pages easier to find.