Documentation

Guides and references

SEO

SEO Best Practices

Guidelines for crawlability, indexation, Search Console, Cloudflare, structured data, and IndexNow.

Crawlability

Robots.txt

  • Avoid unintentional blocks of important pages
  • Ensure critical paths are allowed
  • Reference your sitemap in robots.txt (NextBento does this automatically)

Sitemap

  • Submit /sitemap.xml to Google Search Console and Bing Webmaster Tools
  • Include only canonical, indexable URLs
  • Keep sitemaps updated when adding or removing pages

Site Architecture

  • Keep important pages within 3 clicks of the homepage
  • Use a logical hierarchy and clear internal linking
  • Avoid orphan pages (pages with no internal links)

Indexation

Canonicals

  • Use self-referencing canonical tags on unique pages
  • Ensure HTTP redirects to HTTPS
  • Pick one canonical form (www vs non-www, trailing slash vs no slash) and use it consistently

Noindex Usage

  • Use noindex only for pages you intentionally want excluded (e.g. thank-you pages, duplicate filters)
  • Do not noindex important landing pages, product pages, or blog posts

URL Consistency

  • Stick to one URL format site-wide
  • Use lowercase, hyphen-separated URLs
  • Avoid unnecessary query parameters in canonical URLs

Search Console

  • Submit sitemap — Submit sitemap.xml after adding your property
  • Fix coverage issues — Address errors and excluded pages in the Coverage report
  • Use URL Inspection — Debug indexing for specific URLs and request indexing when needed
  • Monitor Core Web Vitals — Use the Experience report to improve LCP, INP, and CLS

Cloudflare

  • Enable Crawler Hints — See Cloudflare Crawler Hints to signal content changes to search engines
  • Turn off Email Address Obfuscation — Cloudflare rewrites emails to /cdn-cgi/l/email-protection, which 404s in Ahrefs and Search Console. Security → Settings → Email Address Obfuscation → Off. See Cloudflare setup.
  • Proxy main site records — Use the orange cloud for A/AAAA/CNAME records that serve your website
  • Avoid blocking good bots — Do not block Googlebot, Bingbot, or other legitimate crawlers unless necessary

Structured Data

  • Validate — Use Rich Results Test before deploying
  • Match content — Schema must accurately represent visible page content
  • Use JSON-LD — Google recommends JSON-LD; NextBento uses it via components/seo/structured-data.tsx
  • Fix errors promptly — Monitor Search Console Enhancements report for schema issues

IndexNow

  • Run pnpm submit:sitemap after publishing or updating content to notify search engines
  • Ensure INDEXNOW_KEY is set and the key file is accessible at /.well-known/indexnow/{key}.txt
  • Use alongside Crawler Hints when using Cloudflare for full coverage