Questions tagged [rbm]

Restricted Boltzmann Machines, used in contemporary neural networks.

Restricted Boltzmann Machines, used in contemporary s.

70 questions
1
vote
1 answer

Deep autoencoder using RBM

I m implementing Deep autoencoder using RBM. I understand that, for unfolding the network, we need to use the transposed weights of the encoder for the decoder. But I'm not sure which biases should we use for the decoder. I appreciate it if anyone…
1
vote
2 answers

Gaussian visible units in rbm

I want to implement Gaussian RBM.For that i want to make zero mean and unit variance of data.my data is MNIST dataset.The dataset has been taken and followed from the following link. Visit http://www.cs.toronto.edu/~hinton/code/makebatches.m so i…
prakash
  • 125
  • 6
1
vote
2 answers

GRBM implementation

I am implementing Gaussian input based RBM in MATLAB. vi has dimension of 100*784, w has dimension of 784*500, sigma has dimension of 1*784. p(h|v)= sigmoid(cj+wij*vi/sigma^2). I am getting dimensional error when I multiply w*v/sigma^2. I have…
prakash
  • 125
  • 6
1
vote
3 answers

Inferring missing data with Restricted Boltzmann Machines

Similar to the netflix competition, assume we have a movie dataset with missing ratings. How would I modify RBM to allow it to deduce the missing values? In related papers, one straightforward way is to impute random values to the missing visible…
IssamLaradji
  • 6,637
  • 8
  • 43
  • 68
1
vote
1 answer

If I'm using softmax in an RBM, do I need to use it in hidden units as well as in the visible ones?

As I understand, when using softmax of K values in RBM visible units, the hidden unit stays binary. If so - I'm not sure how to compute contributions by the binary units to the visible ones. Am I supposed to relate the binary 0 state in a hidden…
Uri
  • 25,622
  • 10
  • 45
  • 72
1
vote
0 answers

Implementing GB-RBMs for real-valued data

I am trying to implement a Deep Belief Network for speech recognition. And hence, need the first layer of RBM to have gaussian visible units. I used @Andrej Karpathy's matrbm (https://code.google.com/p/matrbm/) and made some changes to convert the…
Nihar Sarangi
  • 4,845
  • 8
  • 27
  • 32
1
vote
1 answer

Alternatives to Restricted Boltzmann Machine for vector data (instead of binary)

I have a very large corpus with each element consisting of a large amount of high dimensional data. Elements are constantly being added to the corpus. Potentially, only a portion of the corpus needs to be considered for each interaction. Elements…
0
votes
0 answers

Is it possible to pass continuous data as input to an RBM model for unsupervised anomaly detection?

Can we pass Continous data as input to RBM. I want to use RBM model for anomaly detection using unsupervised learning but as i know RBM model accepts the binary data but my dataset consists of geohash codes. Please suggest me a feasible…
0
votes
0 answers

RBM is incapable of overfitting a single batch

I am currently working on my master's thesis on the use of deep learning models in recommender systems. I am using the ml-20m dataset, but for testing and debugging purposes, I am scaling down to ml-100k. I have implemented the RBM almost from…
0
votes
1 answer

How do I calculate RBM accuracy for larger dataset other than MNIST and what is the simple coding in R Studio?

I try to run my coding in R studio but it cannot produce the accuracy result. Can you help me with the example of coding to predict accuracy in larger dataset in R Studio using RBM method ? My expected output :1 However my coding below have some…
0
votes
0 answers

Implementation of Sparse autoencoder by tensorflow

I am trying to implement simple autoencoder like below. The number of input features are 2, and I want to build sparse autoencoder for dimension reduction to feature 1. I selected the number of nodes are 2(input), 8(hidden), 1(reduced feature),…
z991
  • 713
  • 1
  • 9
  • 21
0
votes
1 answer

IndentationError: unindent does not match any outer indentation level with python

I'm still a beginner, I dont know what the problem. if __name__ == '__main__': data = ('xx.xlsx') r = RBM(num_visible = 6, num_hidden = 2) training_data = np.array(data) r.train(training_data, max_epochs =…
V.O Vian
  • 53
  • 1
  • 10
0
votes
0 answers

RBM code. AttributeError: 'str' object has no attribute 'shape'. When I try input dataset from excel

I'm a beginner in code and Python. I want to see how this code (RBM) works. And I try to input data from excel. from __future__ import print_function import numpy as np import openpyxl class RBM: def __init__(self, num_visible, num_hidden): …
V.O Vian
  • 53
  • 1
  • 10
0
votes
1 answer

Stacking ReLU RBM into a DBN

I'm implementing a Restricted Boltzmann Machine with Rectified Linear Units. I haven't found a simple implementation anywhere so wanted to ask if somebody would kindly verify the design. Here is the CD1 calculation: def propup(self, vis): …
valend.in
  • 383
  • 1
  • 2
  • 8
0
votes
1 answer

RBM pretraining weights from Hinton paper code for weights of MATLAB native feedforwardnet toolbox

I want to use RBM pretraining weights from Hinton paper code for weights of MATLAB native feedforwardnet toolbox. Anyone can help me how to set or arrange the pre-trained weight for feedforwardnet? for instance, i used Hinton code from…