[REBOL] Re: Rebol indexer
From: andreas:bolka:gmx at: 25-Aug-2003 21:14
Saturday, August 23, 2003, 5:56:50 PM, Hallvard wrote:> http://folk.uio.no/hallvary/rix/looks nice :)> * The robot obeys robots.txt (agent id: RixBot)would you like to factor that code out, so that future writers of bot coul reuse that bit :) ? -- Best regards, Andreas