[REBOL] Re: Cookies
From: dlmayer:flashcom at: 27-Oct-2000 14:16
Carlos...
I have found the following two scripts on www.rebol.org helpful in starting
my development of a webcraller.
Web Crawler Tutorial v1.0
Web Miner
My code is still very basic. It follows:
startsite: ask "URL: " ; the response is the starting url for the search
startsite: to-url startsite
item: make block! ; hold lines read from site
page: read/lines startsite ; read page line-by-line
foreach item page [
parse item [thru {href="} copy text to {"}
Now when I type in a site that has a cookie the program just hangs.
I would very much appreciate someone who could give me advice on how to
automatically answer No to cookies and progress through parsing the page.
... Doug
----- Original Message -----
From: Lorenz <[carlos--lorenz--net]>
To: <[rebol-list--rebol--com]>
Sent: Friday, October 27, 2000 9:07 AM
Subject: [REBOL] Re: Cookies
Do you intend to share your code or not? I'm new to REBOL too and would like
to learn
how to code a useful tool like a webcrawler, for instance :-)
from Brazil
Carlos
----- Original Message -----
From: Douglas Mayer <[dlmayer--flashcom--net]>
To: <[rebol-list--rebol--com]>
Sent: Friday, October 27, 2000 1:19 PM
Subject: [REBOL] Cookies
> I'm new to Rebol and would appreciate some help.
>
> I'm writing a webcrawler and am running into a problem with sites that
have cookies. Once a cookie is sent my script stops as it can't deal with
it.
