[REBOL] Re: Library & smart docs => was:{Re: Re: Parsing comment}
From: chris:langreiter at: 26-Sep-2002 23:21
>>btw, google does not find it, but finds your post which
>>includes a rebsite url
>>
http://www.rebol.org/userlist/archive/504/648.html
> Hmm. I thought that there was not supposed to be a direct
> link anywhere to that archive to prevent spiders getting
> to it ... as email addresses are visible on those pages.
Well, spiders don't get to sites if they observe robots.txt, which
spam address harvesters most certainly don't.
> I think that all dynamically created sites tend to be
> invisible to search engines. Zope is an example.
Not exactly. Search engines have avoided URLs with query strings for a
long time, but how would they distinguish static from dynamic content?
They cannot, it's all bits to them (and us, for that matter ;-).
-- c
