0

I am using DeepLearning4J and nd4j-cuda-10.2. all of the DataSet elements change to zero after I use the shuffle() method. I have traced the code and I think there is a problem with the registerAction() method.

DataSet data;
...
data.shuffle();

this is the data before shuffle:

===========INPUT===================
[[         0,         0,         0,  ...         0,         0,   16.0000], 
 [         0,         0,         0,  ...         0,    1.0000,   16.0000], 
 [    1.0000,         0,         0,  ...         0,    2.0000,   16.0000], 
  ..., 
 [    5.0000,   39.0000,         0,  ...   25.0000,   19.0000,   16.0000], 
 [    5.0000,   40.0000,         0,  ...   25.0000,   19.0000,   16.0000], 
 [    5.0000,   41.0000,         0,  ...   25.0000,   19.0000,   16.0000]]
=================OUTPUT==================
[[         0,         0,         0,         0,    1.0000], 
 [         0,         0,         0,         0,    1.0000], 
 [         0,         0,         0,    1.0000,         0], 
 [         0,    1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,    1.0000,         0,         0,         0], 
 [         0,         0,         0,         0,    1.0000], 
 [         0,         0,         0,    1.0000,         0], 
 [         0,         0,         0,    1.0000,         0], 
 [         0,         0,         0,         0,    1.0000], 
 [         0,    1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,         0,    1.0000,         0,         0], 
 [         0,         0,         0,    1.0000,         0], 
 [         0,         0,         0,    1.0000,         0], 
 [         0,    1.0000,         0,         0,         0], 
 [         0,         0,         0,    1.0000,         0], 
 [         0,    1.0000,         0,         0,         0], 
 [         0,         0,         0,    1.0000,         0], 
 [         0,         0,         0,         0,    1.0000], 
 [         0,         0,    1.0000,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,         0,         0,    1.0000,         0], 
 [         0,         0,    1.0000,         0,         0], 
 [         0,         0,         0,         0,    1.0000], 
 [         0,         0,    1.0000,         0,         0], 
 [         0,    1.0000,         0,         0,         0], 
 [         0,         0,         0,    1.0000,         0], 
 [         0,         0,         0,         0,    1.0000], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,         0,         0,         0,    1.0000], 
 [         0,         0,         0,         0,    1.0000], 
 [         0,         0,         0,         0,    1.0000], 
 [         0,         0,    1.0000,         0,         0], 
 [         0,    1.0000,         0,         0,         0], 
 [         0,         0,    1.0000,         0,         0], 
 [         0,         0,         0,    1.0000,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,    1.0000,         0,         0,         0], 
 [         0,         0,         0,         0,    1.0000], 
 [         0,         0,         0,         0,    1.0000], 
 [         0,         0,    1.0000,         0,         0], 
 [         0,         0,         0,    1.0000,         0], 
 [         0,    1.0000,         0,         0,         0], 
 [         0,    1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,         0,         0,         0,   -1.0000], 
 [         0,         0,         0,         0,    1.0000], 
 [         0,         0,         0,    1.0000,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,         0,    1.0000,         0,         0], 
 [         0,         0,    1.0000,         0,         0], 
 [         0,         0,         0,         0,   -1.0000], 
 [         0,    1.0000,         0,         0,         0], 
 [         0,         0,         0,    1.0000,         0], 
 [         0,         0,         0,    1.0000,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,         0,    1.0000,         0,         0], 
 [         0,         0,         0,   -1.0000,         0], 
 [         0,         0,    1.0000,         0,         0], 
 [         0,         0,    1.0000,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,         0,         0,   -1.0000,         0], 
 [         0,         0,    1.0000,         0,         0], 
 [         0,    1.0000,         0,         0,         0], 
 [         0,         0,         0,         0,   -1.0000], 
 [         0,    1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,    1.0000,         0,         0,         0], 
 [         0,    1.0000,         0,         0,         0], 
 [         0,         0,         0,   -1.0000,         0], 
 [         0,         0,         0,   -1.0000,         0], 
 [         0,    1.0000,         0,         0,         0], 
 [         0,    1.0000,         0,         0,         0], 
 [         0,    1.0000,         0,         0,         0], 
 [         0,         0,         0,         0,   -1.0000], 
 [         0,         0,         0,         0,   -1.0000], 
 [         0,         0,   -1.0000,         0,         0], 
 [         0,         0,   -1.0000,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,         0,         0,         0,   -1.0000], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,         0,         0,         0,   -1.0000], 
 [         0,         0,         0,   -1.0000,         0], 
 [         0,         0,   -1.0000,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,         0,         0,         0,   -1.0000], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,         0,         0,         0,   -1.0000], 
 [         0,         0,         0,   -1.0000,         0], 
 [         0,         0,         0,   -1.0000,         0], 
 [         0,         0,   -1.0000,         0,         0], 
 [         0,         0,         0,   -1.0000,         0], 
 [         0,         0,   -1.0000,         0,         0], 
 [         0,         0,   -1.0000,         0,         0], 
 [         0,         0,         0,         0,   -1.0000], 
 [         0,         0,   -1.0000,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,         0,         0,         0,   -1.0000], 
 [         0,         0,         0,   -1.0000,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,         0,         0,   -1.0000,         0], 
 [         0,         0,         0,         0,   -1.0000], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,         0,         0,   -1.0000,         0], 
 [         0,         0,         0,         0,   -1.0000], 
 [         0,         0,   -1.0000,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,         0,         0,   -1.0000,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,         0,         0,         0,   -1.0000], 
 [         0,         0,   -1.0000,         0,         0], 
 [         0,         0,         0,         0,   -1.0000], 
 [         0,         0,         0,   -1.0000,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,         0,         0,   -1.0000,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,         0,         0,   -1.0000,         0], 
 [         0,         0,   -1.0000,         0,         0], 
 [         0,         0,         0,   -1.0000,         0], 
 [         0,         0,   -1.0000,         0,         0], 
 [         0,         0,   -1.0000,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,         0,   -1.0000,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,         0,   -1.0000,         0,         0], 
 [         0,         0,   -1.0000,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,         0,         0,   -1.0000,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,         0,         0,   -1.0000,         0], 
 [         0,         0,   -1.0000,         0,         0], 
 [         0,         0,   -1.0000,         0,         0], 
 [         0,         0,   -1.0000,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,         0,         0,   -1.0000,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,         0,         0,         0,   -1.0000], 
 [         0,         0,         0,         0,   -1.0000], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,         0,   -1.0000,         0,         0], 
 [         0,         0,         0,   -1.0000,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,         0,         0,         0,   -1.0000], 
 [         0,         0,         0,   -1.0000,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,         0,         0,         0,   -1.0000], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,         0,         0,   -1.0000,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,         0,   -1.0000,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,         0,   -1.0000,         0,         0], 
 [         0,         0,         0,   -1.0000,         0], 
 [         0,         0,         0,   -1.0000,         0], 
 [         0,         0,         0,   -1.0000,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,         0,   -1.0000,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,   -1.0000,         0,         0,         0], 
 [         0,         0,         0,   -1.0000,         0]]

and after:

===========INPUT===================
[[         0,         0,         0,  ...         0,         0,         0], 
 [         0,         0,         0,  ...         0,         0,         0], 
 [         0,         0,         0,  ...         0,         0,         0], 
  ..., 
 [         0,         0,         0,  ...         0,         0,         0], 
 [         0,         0,         0,  ...         0,         0,         0], 
 [         0,         0,         0,  ...         0,         0,         0]]
=================OUTPUT==================
[[         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0], 
 [         0,         0,         0,         0,         0]]

in the registerAction() method operand.lengh is always Zero:

public void registerAction(CudaContext context, INDArray result, INDArray... operands) {
    if (result != null && !result.isEmpty()) {
        AllocationPoint point = this.allocator.getAllocationPoint(result);
        point.tickDeviceWrite();
        INDArray[] var5 = operands;
        int var6 = operands.length;

        for(int var7 = 0; var7 < var6; ++var7) {
            INDArray operand = var5[var7];
            if (operand != null && !operand.isEmpty()) {
                AllocationPoint pointOperand = this.allocator.getAllocationPoint(operand);
                pointOperand.tickDeviceRead();
            }
        }

    }
}
talonmies
  • 70,661
  • 34
  • 192
  • 269
jahan afrouz
  • 1
  • 1
  • HI, could you file an issue at https://gthub.com/eclipse/deeplearning4j/issues? Thanks! – Adam Gibson Dec 20 '20 at 23:19
  • is this the right address? I couldn't open it. – jahan afrouz Dec 21 '20 at 09:23
  • Sorry project is hosted on github. github.com/eclipse/deeplearning4j/issues – Adam Gibson Dec 22 '20 at 00:43
  • I am having so much trouble using this library. even a simple example like IrisClassifieron on the repository won't run correctly. the neural network output is the same for all inputs. I can't figure out what am I missing. – jahan afrouz Dec 23 '20 at 17:32
  • could you be more concrete? If you can update your question, I'm happy to help. We have several getting started guides and examples at https://github.com/eclipse/deeplearning4j-examples - if you can be more specific maybe I could solve your issue? – Adam Gibson Dec 24 '20 at 08:54
  • Hi @jahan: I commented on your github issue. Sorry for not seeing that. – Adam Gibson Dec 24 '20 at 11:40

0 Answers0