Stack Overflow
Stack Overflow

Questions tagged [rbm]

Restricted Boltzmann Machines, used in contemporary neural networks.

Restricted Boltzmann Machines, used in contemporary s.

70 questions
1
vote
0 answers

Library of “sklearn.neural_network.BernoulliRBM” that Creates Highly Correlated Features

I’m using the sklearn library to generate new features of a dataset using a Restricted Boltzmann Machine (RBM, sklearn.neural_network.BernoulliRBM). I use the following environment: python 3.5.0 numpy==1.11.1 scikit-learn==0.18 I have already tried…
mknd
  • 19
  • 2
1
vote
0 answers

How to analyse and interpret features learned by a RBM?

I've trained a single layer, 100 hidden unit RBM with binary input units and ReLU activation on the hidden layer. Using a training set of 50k MNIST images, I end up with ~5% RMSE on the 10k image test set after 500 epochs of full-batch training with…
valend.in
  • 383
  • 1
  • 2
  • 8
1
vote
0 answers

Training an RBM with Denoising Contrastive Divergence ?

Just recently, I was wondering why nobody seems to use denoising training for Restricted Boltzmann Machine (RBM) and Convolutional-RBM (CRBM) models. This is very powerful for auto-encoders (Denoising Auto-Encoders (DAE) and Stacked-DAE (SDAE)). I…
Baptiste Wicht
  • 7,472
  • 7
  • 45
  • 110
1
vote
0 answers

Deep Belief Network inference: hidden layers need random number generator?

I am learning Deep Belief Network and Restricted Boltzmann Machine. In training DBN (CD-1, greedy, layer-wise), inputs to the second, third, and nth RBM should be stochastic binary (0 or 1) and not probability? As for the inference process in DBN,…
Yoko
  • 11
  • 1
1
vote
0 answers

Custom operation implementation for RBM/DBN with tensorflow?

Since Google released out tensorflow, it becomes kind of trend in the current deep learning selections. I'd like to do some experiments about RBM/DBN (Restricted Boltzmann Machine/Deep Belief Network), I've made some attempt by myself and kind of…
myme5261314
  • 462
  • 1
  • 5
  • 14
1
vote
0 answers

how to use binary RBM for deep learning with tanh

I understand we need to use different types of hidden unit other than binary, if we are dealing with rectifier, continuous input, etc. in RBM. Now suppose RBM is used as starting point for supervised deep learning, how about tanh activation? Can we…
russiancube
  • 11
  • 3
1
vote
1 answer

Need some help for deeplearning4j single RBM usage

I have a bunch of sensors and I really just want to reconstruct the input. So what I want is this: after I have trained my model I will pass in my feature matrix get the reconstructed feature matrix back I want to investigate which sensor values…
KIC
  • 5,887
  • 7
  • 58
  • 98
1
vote
1 answer

How to train an unsupervised neural network such as RBM?

Is this process correct? Suppose We have a bunch of data such as MNIST. We just feed all these data(without label) to RBM and resample each data from trained model. Then output can be treated as new data for classification. Do I understand it…
vvilp
  • 423
  • 4
  • 10
1
vote
0 answers

How do I check or validate the RBM (Restricted Boltzmann Machine) Model?

I'm trying to implement RBM, then i used play tennis case to test the rbm. I've tried autoencoder before, and the result was good. Actually, I confuse with the function of RBM it self, i think it just like autoencoder, encode the input (each…
Hendri
  • 45
  • 6
1
vote
1 answer

RBM for collaborative filtering

My algorithm RBM for collaborative filtering will not converge... The idea of what I think RBM　for collaborative filtering is initial w , b , c and random at [0,1] For By User clamp data -> visible (softmax) Hidden = sigmoid(b+W*V) Run Gibbs on…
Dan Chen
  • 11
  • 3
1
vote
1 answer

What's the reason behind "extracting 8x8 patches" in Restricted Boltzman Machine?

I came accros this documentation on pyLearn2 (Machine Learning library) example of RBM. Could someone tell me why it is easier? # First we want to pull out small patches of the images, since it's easier # to train an RBM on…
Denny Dharmawan
  • 167
  • 3
  • 13
1
vote
1 answer

Measuring success of Restricted Boltzmann Machine

I am trying to implement my own RBM, but I am not sure, how to measure it's success 100% correctly. So I started googling and have found many interpretations and I am not sure what is correct. I am facing this problem: I have dataset Z, so I can…
Snurka Bill
  • 973
  • 4
  • 12
  • 29
1
vote
0 answers

data propagation through restriced boltzmann machine

In RBM, it makes all relationships within node in probability. then how data can be propagated through RBM? just first order sampling? doesnt then have too much fluctuation? or does it work like feed forward mlp? (ie. hj = \sum_i vi * wij) but in…
forsythia
  • 265
  • 1
  • 2
  • 5
1
vote
1 answer

Gaussian-Bernoulli RBM high reconstruction error

I'm normalizing my data to zero mean and unit variance as recommended in most literature to pre-train a GB-RBM. But whatever learning rate I choose and whatsoever is the number of epochs, my mean reconstruction error never drops below around…
muneeb
  • 142
  • 13
1
vote
0 answers

Why asymmetric weights of RBM can be learned although the network is symmetry?

I tried to implement the Restricted Boltzmann Machine to confirm the utility of the deep learning method. I implemented a RBM and fed the MNIST character recognition data for one layer reconstruction. But the learned weights of edges were same for…
chiral
  • 11
  • 3
1 2
3
4 5