[REBOL] Problems handling large txt files with open/direct/binary
From: jmalv::hotmail::com at: 6-Mar-2002 14:23
Hi all,
I am processing a large text data file (over 100 MB) in a Linux RH 7.2 box
with 256 MB memory.
I tried to use open/direct/lines but I had problems with lines above 4096
chars so I use open/direct/binary and the following function to read lines:
read-lines: func [ f [port!] /local line data ] [
line: copy ""
while [ (data: copy/part f 1) <> #{0A} ] [
append line data
if data == none [ break ]
]
if data == none [ line: none ]
line
]
Do you have any suggestions for the following problems:
1. I can not get the loop to finish nicely at EOF
The loop is ---> while [ not none? line ] [ ]
2. I get the following error but I have no info about it:
Invalid datatype during recycle
Ocasionally I also get a segmentation fault
Any ideas are welcome. Thanks a lot
_________________________________________________________________
Join the world’s largest e-mail service with MSN Hotmail.
