The administrator of said site has the ability to allow, or deny access to spiders. So even if you need a pword to enter, the spider will still have access. This is different if pages (such as myspace, facebook, etc) are marked private. The spider can't access them.
No comments:
Post a Comment