[REBOL] Large Files and Binary Read
From: james:mustard at: 20-Oct-2002 22:49
Hi folks,
I've recently been working with large amounts of GIS data and am looking
for a way to read arbitrary windows into the data matrix from rebol.
I tried the following (which dies in Win2k and linux with out of
memory).
;-----------------------------------------------------
rebol []
window-data: copy []
offset-column: 30000
data-length: 1500
for y 10000 10499 1 [
window-data: append window-data read/binary/skip/part
%/mnt/hda2/eastern_hemisphere.raw ((y * 64800 ) + offset-column)
data-length
]
print length? window-data
halt
;-----------------------------------------------------
this is with the Jun 2001 version of View 1.2.3 or sommit like that.
I tried the read parameters in different orders and same error. The
annoying thing is that I can write something to skip/scan the datastream
in C/C++ quite easily without reading the ENTIRE file into memory. Did
I use the wrong rebol command or can rebol not handle 1.5GB+ files
without a corresponding amount of ram?
I currently and doing this on 512MB DDR with Athlon XP 2000+ chip and
60GB HDD. I will soon be moving to data-windows on 4GB+ files so it is
rather important I get this figured out :P
thanks,
James.