[REBOL] Rebol indexer
From: hallvard:ystad:helpinhand at: 23-Aug-2003 17:56
Hi list,
Some of you may remember I made a little search engine to register web pages with the
word "rebol" in them some time back. Ingo suggested I also register rebol scripts. I've
had some spare time the last few days, and the result is here:
http://folk.uio.no/hallvary/rix/
This still is a robot that registers all pages with the word «rebol» in them, but there
are some changes (in the robot and in the search interface):
* The robot obeys robots.txt (agent id: RixBot)
* html and script files available on the web are registered alike
* users may choose to search in html files only, script files only or both (based on
the http mimeType header)
I noticed that rebol scripts are treated differently on different servers (surprise?
not really). Some call them text/plain, others text/x-rebol-application. I'll look into
that (and other things) later, if my wife goes on another week-end trip with the kids
... (possible enhancements: searching of different parts of rebol header etc.)
As for the name, you can see that I chose to call it Rix. I like it, it's short and easy
to pronounce, and I don't think there are a million other applications with that name
out there already.
Comments are welcome.
Hallvard
