Thursday, December 15, 2011

How will search spiders/bots search a web site that is open to members only.?

The administrator of said site has the ability to allow, or deny access to spiders. So even if you need a pword to enter, the spider will still have access. This is different if pages (such as myspace, facebook, etc) are marked private. The spider can't access them.

0 comments:

Post a Comment