Introduction to Noindex Tags
Google’s Search Relations team has released a new SEO Office Hours video with Martin Splitt, tackling a common problem many website owners face: unwanted noindex tags that keep pages out of search results. In the video, Splitt helps a user named Balant who couldn’t remove a noindex tag from their website. Balant wanted their page to be public, but the tag prevented this.
Where Unwanted Noindex Tags Come From
Splitt listed several places where unwanted noindex tags might be hiding. He emphasized the importance of checking the source code, JavaScript, and third-party JavaScript. A/B testing tools often cause this problem, as they sometimes add noindex tags to test versions of pages without the owner’s knowledge.
CDN and Cache Problems
If you use a Content Delivery Network (CDN), Splitt warned that old cached versions might still have noindex tags even after you remove them from your site. This is because the cache might not have updated yet. Splitt explained that this can be a common issue, and it’s essential to check the cache to ensure it’s up-to-date.
Checking CMS Settings and Plugins
Splitt also explained that your Content Management System (CMS) settings might be adding noindex tags without your knowledge. He suggested checking the CMS settings and plugins for SEO, ensuring that settings labeled as "disallow search engines" are unchecked. This will allow your content to appear in search results.
Debugging Process for Persistent Noindex Issues
If you’re dealing with stubborn noindex problems, Splitt suggests checking the following places in order:
- Check your HTML source code directly
- Look at JavaScript files that might add meta tags
- Review third-party scripts, especially testing tools
- Check if your CDN cache needs updating
- Look at your CMS settings and SEO plugins
Importance of Technical SEO Checks
Google’s advice shows why thorough technical SEO checks are essential. Modern websites are complex, with dynamic content and third-party tools, making it necessary to dig deeper to find technical SEO problems. SEO professionals should regularly crawl their sites with tools that process JavaScript to understand how search engines interpret their pages.
Using Google’s URL Inspection Tool
If your pages aren’t showing up in search results, use Google’s URL Inspection tool in the Search Console. This tool shows you how Google sees your page and whether any noindex tags exist. By using this tool, you can identify and fix issues that might be preventing your content from appearing in search results.
Conclusion
In conclusion, unwanted noindex tags can be a frustrating issue for website owners. However, by following Splitt’s advice and checking the source code, JavaScript, CDN cache, and CMS settings, you can identify and fix the problem. Remember to regularly crawl your site with tools that process JavaScript and use Google’s URL Inspection tool to ensure your content is visible to search engines. By taking these steps, you can ensure your pages appear in search results and reach your target audience.