Mailing List Archive: 49091 messages
  • Home
  • Script library
  • AltME Archive
  • Mailing list
  • Articles Index
  • Site search

[REBOL] Rebol indexer

From: hallvard:ystad:helpinhand at: 23-Aug-2003 17:56

Hi list, Some of you may remember I made a little search engine to register web pages with the word "rebol" in them some time back. Ingo suggested I also register rebol scripts. I've had some spare time the last few days, and the result is here: This still is a robot that registers all pages with the word «rebol» in them, but there are some changes (in the robot and in the search interface): * The robot obeys robots.txt (agent id: RixBot) * html and script files available on the web are registered alike * users may choose to search in html files only, script files only or both (based on the http mimeType header) I noticed that rebol scripts are treated differently on different servers (surprise? not really). Some call them text/plain, others text/x-rebol-application. I'll look into that (and other things) later, if my wife goes on another week-end trip with the kids ... (possible enhancements: searching of different parts of rebol header etc.) As for the name, you can see that I chose to call it Rix. I like it, it's short and easy to pronounce, and I don't think there are a million other applications with that name out there already. Comments are welcome. Hallvard