[REBOL] Re: Cookies
From: bo:rebol at: 27-Oct-2000 14:42
And don't forget the webcrawler on www.rebol.com in the script library!
-Bo
On 27-Oct-2000/14:16:27-7:00, [dlmayer--flashcom--net] wrote:
>Carlos...
>
>I have found the following two scripts on www.rebol.org helpful in starting
>my development of a webcraller.
>
>Web Crawler Tutorial v1.0
>Web Miner
>
>My code is still very basic. It follows:
>
>startsite: ask "URL: " ; the response is the starting url for the search
>startsite: to-url startsite
>item: make block! ; hold lines read from site
>page: read/lines startsite ; read page line-by-line
>foreach item page [
> parse item [thru <lb>href="<rb> copy text to <lb>"<rb>
>
>Now when I type in a site that has a cookie the program just hangs.
>
>I would very much appreciate someone who could give me advice on how to
>automatically answer No to cookies and progress through parsing the page.
>
>.... Doug
>----- Original Message -----
>From: Lorenz <[carlos--lorenz--net]>
>To: <[rebol-list--rebol--com]>
>Sent: Friday, October 27, 2000 9:07 AM
>Subject: [REBOL] Re: Cookies
>
>Do you intend to share your code or not? I'm new to REBOL too and would like
>to learn
>how to code a useful tool like a webcrawler, for instance :-)
>from Brazil
>Carlos
>
>----- Original Message -----
>From: Douglas Mayer <[dlmayer--flashcom--net]>
>To: <[rebol-list--rebol--com]>
>Sent: Friday, October 27, 2000 1:19 PM
>Subject: [REBOL] Cookies
>
>>
>> I'm new to Rebol and would appreciate some help.
>>
>> I'm writing a webcrawler and am running into a problem with sites that
>have cookies. Once a cookie is sent my script stops as it can't deal with
>it.
>>
>> Would appreciate any help on writing the code that will determine if a
>cookie has been sent and then respond (yes/no) to it.
>>
>> Thanks in advance...
>> Doug Mayer
>>
>> --
>> To unsubscribe from this list, please send an email to
>> [rebol-request--rebol--com] with "unsubscribe" in the
>> subject, without the quotes.
>>
>>
>
>--
>To unsubscribe from this list, please send an email to
>[rebol-request--rebol--com] with "unsubscribe" in the
>subject, without the quotes.
>
>--
>To unsubscribe from this list, please send an email to
>[rebol-request--rebol--com] with "unsubscribe" in the
>subject, without the quotes.
>
--
Bohdan "Bo" Lechnowsky
REBOL Adventure Guide
REBOL Technologies 707-467-8000 (http://www.rebol.com)
The Official Source for REBOL Books (http://www.REBOLpress.com)
