Search Engine Eligibility Checks

[Chip (OP)]

# 1. Check robots.txt for crawler blocks
curl -s https://drugs-and-users.org/robots.txt

# 2. Check for stray noindex meta tags on key pages
curl -s https://drugs-and-users.org/ | grep -i 'noindex\|robots'
curl -s https://drugs-and-users.org/index.php | grep -i 'noindex\|robots'

# 3. Check for X-Robots-Tag header (this is the sneaky one — won't show in page source)
curl -sI https://drugs-and-users.org/ | grep -i 'x-robots'
curl -sI https://drugs-and-users.org/index.php | grep -i 'x-robots'

# 4. Check sitemap exists and is reachable
curl -sI https://drugs-and-users.org/sitemap.xml

# 5. Spot-check a board page (since BCI board 110 and others matter to you)
curl -s "https://drugs-and-users.org/index.php?board=110.0" | grep -i 'noindex\|canonical'

# 6. Recursively check your Sources and Themes dirs are clean (where you found the original noindex propagation)
grep -ril 'noindex' /var/www/html/Sources/ /var/www/html/Themes/ 2>/dev/null