Mailing List Archive: 49091 messages
  • Home
  • Script library
  • AltME Archive
  • Mailing list
  • Articles Index
  • Site search

[REBOL] Re: Library & smart docs => was:{Re: Re: Parsing comment}

From: chris:langreiter at: 26-Sep-2002 23:21

>>btw, google does not find it, but finds your post which >>includes a rebsite url >> > Hmm. I thought that there was not supposed to be a direct > link anywhere to that archive to prevent spiders getting > to it ... as email addresses are visible on those pages.
Well, spiders don't get to sites if they observe robots.txt, which spam address harvesters most certainly don't.
> I think that all dynamically created sites tend to be > invisible to search engines. Zope is an example.
Not exactly. Search engines have avoided URLs with query strings for a long time, but how would they distinguish static from dynamic content? They cannot, it's all bits to them (and us, for that matter ;-). -- c