4

I have a 'huge' amount of data, which may vary between 50 and 100 MegaBytes. I read this data in as an array of bytes using a filestreamer.

The thing is, I want to convert all consecutive 2 bytes into an integer. The way I do this is I loop through the array of bytes with a stepsize of two, and then use BitConvert to do the conversion:

_data[i] = BitConverter.ToInt16(soundData[i : i + 2], 0) // Convert 2 bytes into an int and store at i

So each two bytes get turned into an Int16. The problem however, is that this is too slow, as for a file of about 50 megabytes this can take up 20 seconds!

Is there a generic way of doing this instantly, instead of calling this function on each 2 bytes of my data array such that it isn't that slow? Preferably in a 'safe' way, so no unsafe code.

Charles
  • 50,943
  • 13
  • 104
  • 142
Shammah
  • 619
  • 1
  • 5
  • 12
  • "Fast"? "Mono"? http://www.mono-project.com/Interop_with_Native_Libraries – paulsm4 Jan 01 '13 at 21:49
  • 3
    The whole point of a *stream* is to process the data while loading it, not to load it first and then iterate over it. Is the conversion really the bottleneck? Could you include the loop in your question? – Adam Jan 01 '13 at 21:59

2 Answers2

4

If the array of bytes are in the correct Endian, then just allocate an Int16 array and use Buffer.Block copy (air code):

byte[] b = new byte[]{1, 2, 3, 4};
short[] s = new short[2]; // 4 bytes long
Buffer.BlockCopy(b, 0, s, 0, 4);
Kelly Ethridge
  • 1,669
  • 1
  • 11
  • 12
  • The endianness was indeed correct, and using this method my 50MB data was able to be converted in 1.5s instead of the 15-20s, which is a drastic improvement! – Shammah Jan 02 '13 at 17:26
3

Without testing, I'm not sure I have the math and "endianess" right, but the other option would be to try something like this:

// Convert 2 bytes into an int and store at i
_data[j] = (int)soundData[i] + (soundData[i + 1] << 8);

If that's also not fast enough, then you may need a different approach to the problem.

Some other ideas can be found for the question: Convert Byte Array to Integer In VB.Net

Community
  • 1
  • 1
Jonathan Wood
  • 65,341
  • 71
  • 269
  • 466