Mailing List Archive: 49091 messages
  • Home
  • Script library
  • AltME Archive
  • Mailing list
  • Articles Index
  • Site search

[REBOL] Re: Cookies

From: dlmayer:flashcom at: 27-Oct-2000 14:16

Carlos... I have found the following two scripts on helpful in starting my development of a webcraller. Web Crawler Tutorial v1.0 Web Miner My code is still very basic. It follows: startsite: ask "URL: " ; the response is the starting url for the search startsite: to-url startsite item: make block! ; hold lines read from site page: read/lines startsite ; read page line-by-line foreach item page [ parse item [thru {href="} copy text to {"} Now when I type in a site that has a cookie the program just hangs. I would very much appreciate someone who could give me advice on how to automatically answer No to cookies and progress through parsing the page. ... Doug ----- Original Message ----- From: Lorenz <[carlos--lorenz--net]> To: <[rebol-list--rebol--com]> Sent: Friday, October 27, 2000 9:07 AM Subject: [REBOL] Re: Cookies Do you intend to share your code or not? I'm new to REBOL too and would like to learn how to code a useful tool like a webcrawler, for instance :-) from Brazil Carlos ----- Original Message ----- From: Douglas Mayer <[dlmayer--flashcom--net]> To: <[rebol-list--rebol--com]> Sent: Friday, October 27, 2000 1:19 PM Subject: [REBOL] Cookies
> I'm new to Rebol and would appreciate some help. > > I'm writing a webcrawler and am running into a problem with sites that
have cookies. Once a cookie is sent my script stops as it can't deal with it.