Posted by Dr. Bob on September 8, 2002, at 21:03:18
In reply to Re: Search engines » Jane D and Oracle, posted by Jonathan on September 5, 2002, at 20:56:07
> Personally I'd like to see all the boards indexed separately, so if for instance I start my search on PPB, it only searches PPB.
>
> tabithaYou should be able to limit it to a particular (included) board manually with the "url" option, for example, "url:social". See:
http://www.dr-bob.org/cgi-bin/xv/search.pl
----
> > I don't suppose there is a way to prevent Social (and 2000 and admin) from being picked up by the search engines, is there?
>
> Actually, it *is* possible, at least for search engines that look for and respect a "robots.txt" file in the site's root directory
>
> JonathanPart of it is that it depends on search engines doing that, and they don't necessarily...
Bob
poster:Dr. Bob
thread:7296
URL: http://www.dr-bob.org/babble/admin/20020725/msgs/7325.html