In this episode of Ask Google Webmasters, John Mueller goes over special files in robots.txt such as *.css, php.ini, and .htaccess, and explains why one does not have to and should not disallow these files from being crawled. The question was submitted by @svperflvid. Thank you!

Send us your questions on Twitter with the hashtag AskGooglebot and your question might be answered!
Google Search Central on Twitter →

Watch more AskGooglebot episodes →
Subscribe to the Google Search Central Channel →



There are no comments yet.

Leave a comment