[REBOL] Re: Rebol web presence statistics
From: carl:cybercraft at: 20-Mar-2004 6:58
On 20-Mar-04, Hallvard Ystad wrote:
> Dixit Carl Read (11.40 19.03.2004):
>> One suggestion for the results: I'd like to see the URL's shown
>> too, as they provide extra info not given by the webpages' headers.
>> Three or four links all just saying "REBOL.org Script Library" are
>> not that helpful. Yes, we can put the mouse-pointer over them, but
>> that's not too friendly.
> You're right - so now the URLs are shown.
That's better - and still nice and tidy too.
>> I just did...
>> RIX URL Submission
>> OK, your URL wasn't found in the database, so it was added to
>> the
>> checklist. Thanks for submitting.
>> RIX works at a pace of 5000 site updates per night. There are
>> currently 233432 websites before you in the queue, so this URL
>> should be indexed around 5-May-2004. But keep in mind that this
>> is only an approximate suggestion.
>> It's going to be quite a busy little bot for the forseeable future,
>> isn't it? (-:
> Oh yes. And it all started with http://www.rebol.com/ in the
> beginning. The bot checks all links _from_ pages that contain the
> word "rebol". Pages that do not contain the word does not get their
> links checked. It's amazing how many URLs have lined up on the
> checklist. 5000 records per day is my choice. If the bot ran all the
> time, it could reach about 15000-25000, I guess, so maybe that's
> worth a try for a period of time.
But a bit rough on your bot! :-)
Perhaps the "submitted by hand" URLs could be put to the top of the
list? It's unlikely you'll get many a day and so it shouldn't make
much of an impact on your searching, but it would be a bit of
encouragement for the people who take the trouble to add an URL.
--
Carl Read
