[REBOL] Re: Rebol web presence statistics
From: hallvard:ystad:oops-as:no at: 19-Mar-2004 22:03
Dixit Carl Read (11.40 19.03.2004):
>One suggestion for the results: I'd like to see the URL's shown too,
>as they provide extra info not given by the webpages' headers. Three
>or four links all just saying "REBOL.org Script Library" are not that
>helpful. Yes, we can put the mouse-pointer over them, but that's not
>too friendly.
You're right - so now the URLs are shown.
>I just did...
>
> RIX URL Submission
>
> OK, your URL wasn't found in the database, so it was added to the
> checklist. Thanks for submitting.
>
> RIX works at a pace of 5000 site updates per night. There are
> currently 233432 websites before you in the queue, so this URL
> should be indexed around 5-May-2004. But keep in mind that this
> is only an approximate suggestion.
>
>It's going to be quite a busy little bot for the forseeable future,
>isn't it? (-:
Oh yes. And it all started with http://www.rebol.com/ in the beginning. The bot checks
all links _from_ pages that contain the word "rebol". Pages that do not contain the word
does not get their links checked. It's amazing how many URLs have lined up on the checklist.
5000 records per day is my choice. If the bot ran all the time, it could reach about
15000-25000, I guess, so maybe that's worth a try for a period of time.
HY
