Mailing List Archive: 49091 messages
  • Home
  • Script library
  • AltME Archive
  • Mailing list
  • Articles Index
  • Site search

[REBOL] Large Files and Binary Read

From: james:mustard at: 20-Oct-2002 22:49

Hi folks, I've recently been working with large amounts of GIS data and am looking for a way to read arbitrary windows into the data matrix from rebol. I tried the following (which dies in Win2k and linux with out of memory). ;----------------------------------------------------- rebol [] window-data: copy [] offset-column: 30000 data-length: 1500 for y 10000 10499 1 [ window-data: append window-data read/binary/skip/part %/mnt/hda2/eastern_hemisphere.raw ((y * 64800 ) + offset-column) data-length ] print length? window-data halt ;----------------------------------------------------- this is with the Jun 2001 version of View 1.2.3 or sommit like that. I tried the read parameters in different orders and same error. The annoying thing is that I can write something to skip/scan the datastream in C/C++ quite easily without reading the ENTIRE file into memory. Did I use the wrong rebol command or can rebol not handle 1.5GB+ files without a corresponding amount of ram? I currently and doing this on 512MB DDR with Athlon XP 2000+ chip and 60GB HDD. I will soon be moving to data-windows on 4GB+ files so it is rather important I get this figured out :P thanks, James.