Web1.0 Hosting Forum - robots.txt and other txt files? https://forum.w10.host/ Save the Old Web! en robots.txt and other txt files? (reply) http://web1.0hosting.net/faq/ have you read this?

if there are no answers to the questions there, I would like to hear a more specific question.

regarding robots.txt, the simplest instructions are on the Internet, we did not post them because they are the same for everyone and everywhere

]]> https://forum.w10.host/index.php?id=147 https://forum.w10.host/index.php?id=147 Fri, 21 Mar 2025 20:35:09 +0000 HTML, JS, another tricksTurboblack robots.txt and other txt files? I get Robots.txt is supposed to help with automated web crawlers, but anyone have a 'for dummies' overview?

Are there any other *.txt files I could include at the top level that could do neat things?

]]> https://forum.w10.host/index.php?id=145 https://forum.w10.host/index.php?id=145 Fri, 21 Mar 2025 20:10:53 +0000 HTML, JS, another trickssingletona082