SEO
SEO Best Practices
Guidelines for crawlability, indexation, Search Console, Cloudflare, structured data, and IndexNow.
Crawlability
Robots.txt
- Avoid unintentional blocks of important pages
- Ensure critical paths are allowed
- Reference your sitemap in robots.txt (NextBento does this automatically)
Sitemap
- Submit
/sitemap.xmlto Google Search Console and Bing Webmaster Tools - Include only canonical, indexable URLs
- Keep sitemaps updated when adding or removing pages
Site Architecture
- Keep important pages within 3 clicks of the homepage
- Use a logical hierarchy and clear internal linking
- Avoid orphan pages (pages with no internal links)
Indexation
Canonicals
- Use self-referencing canonical tags on unique pages
- Ensure HTTP redirects to HTTPS
- Pick one canonical form (www vs non-www, trailing slash vs no slash) and use it consistently
Noindex Usage
- Use
noindexonly for pages you intentionally want excluded (e.g. thank-you pages, duplicate filters) - Do not noindex important landing pages, product pages, or blog posts
URL Consistency
- Stick to one URL format site-wide
- Use lowercase, hyphen-separated URLs
- Avoid unnecessary query parameters in canonical URLs
Search Console
- Submit sitemap — Submit
sitemap.xmlafter adding your property - Fix coverage issues — Address errors and excluded pages in the Coverage report
- Use URL Inspection — Debug indexing for specific URLs and request indexing when needed
- Monitor Core Web Vitals — Use the Experience report to improve LCP, INP, and CLS
Cloudflare
- Enable Crawler Hints — See Cloudflare Crawler Hints to signal content changes to search engines
- Turn off Email Address Obfuscation — Cloudflare rewrites emails to
/cdn-cgi/l/email-protection, which 404s in Ahrefs and Search Console. Security → Settings → Email Address Obfuscation → Off. See Cloudflare setup. - Proxy main site records — Use the orange cloud for A/AAAA/CNAME records that serve your website
- Avoid blocking good bots — Do not block Googlebot, Bingbot, or other legitimate crawlers unless necessary
Structured Data
- Validate — Use Rich Results Test before deploying
- Match content — Schema must accurately represent visible page content
- Use JSON-LD — Google recommends JSON-LD; NextBento uses it via
components/seo/structured-data.tsx - Fix errors promptly — Monitor Search Console Enhancements report for schema issues
IndexNow
- Run
pnpm submit:sitemapafter publishing or updating content to notify search engines - Ensure
INDEXNOW_KEYis set and the key file is accessible at/.well-known/indexnow/{key}.txt - Use alongside Crawler Hints when using Cloudflare for full coverage
Related Docs
- SEO Overview — Metadata, sitemaps, robots.txt, IndexNow
- Google Search Console Setup — Add and verify your property
- Cloudflare Crawler Hints — Add site and enable Crawler Hints