Board Index › Knowledge Base › SEO Configuration › Optimizing robots.txt via phpBB ACP

Optimizing robots.txt via phpBB ACP

Manage crawl budget and instruct search engine bots with a managed robots.txt file.

The Pro Robots.txt Editor lets you manage search bot instructions directly within ACP.

Image
Figure: Dynamic robots.txt Configuration, Auto-Protection Rules & Live Preview in ACP

Recommended phpBB robots.txt Template:

Code: Select all

User-agent: *
Disallow: /adm/
Disallow: /ucp.php
Disallow: /mcp.php
Disallow: /posting.php
Disallow: /search.php
Disallow: /memberlist.php

Sitemap: https://www.phpbbseo.com/sitemap.xml
Sitemap: https://www.phpbbseo.com/knowledge/sitemap.xml
This prevents search crawlers from wasting crawl budget on private forms, search results, and login pages while directing them to your sitemaps.

Share this article

Share this guide with your network and community.

Was this article helpful?
Login to vote.