0

I am trying to do the simplest indexing of an ff vector in R v3.1.0, on a Windows 2008 server. The following basic code:

x = ff(1:10)
x[ff(2:3)]

Returns the error:

Error in ffindexget(x, i) : 
cannot allocate memory block of size 67108864 Tb
In addition: Warning message:
In bbatch(length, BATCHBYTES/(recvalbytes + 2 * recindbytes)) :
NAs introduced by coercion

Any insights as per how/why could that possibly happen? The code runs perfectly on my local Windows 7 machine, hence am I right to assume the issue is with the operating system? Many thanks in advance.

Audrey
  • 212
  • 4
  • 15
  • I believe your hard disk is full –  Jul 04 '14 at 08:12
  • Thanks for the comment, but I am not sure this is the case. I can upload any object, in their gigabytes. It seems like an indexing function issue at first glance. – Audrey Jul 04 '14 at 08:44
  • Maybe it is indeed related to your hardware. What are your ff options available in options() ? –  Jul 05 '14 at 11:59
  • This is what I found, if of any help? `$ffbatchbytes [1] 733992714 $ffcaching [1] "mmnoflush" $ffdrop [1] TRUE $ffextension [1] "ff" $fffinonexit [1] TRUE $ffmaxbytes [1] 36699635712 $ffpagesize [1] 65536` – Audrey Jul 07 '14 at 09:54
  • You could try in reducing the ffbatchbytes option. Your error message looks like there was a numeric overflow before the ffindexget. So try out changing ffbatchbytes to something lower than the defaults of your incredible machine. e.g. options(ffbatchbytes = 37570478) –  Jul 08 '14 at 12:42
  • Tried it, same error unfortunately. – Audrey Jul 11 '14 at 11:28
  • Have you also tried to change the ffmaxbytes option to something lower (like what is on your Windows 7 machine)? ffindexget has an option BATCHBYTES = getOption("ffmaxbytes"). You could consider decreasing the ffmaxbytes option. FYI, mine is 536870912. –  Jul 14 '14 at 10:25

0 Answers0