Questions tagged [bias-neuron]

68 questions
1
vote
1 answer

Tensorflow wrong bias initialization

I'm initializing my 2 sets of weights/bias using the same function 1st set: W_omega = tf.Variable(tf.random_uniform([hidden_size, attention_size], -0.1, 0.1), name='W_omega') b_omega = tf.Variable(tf.random_uniform([attention_size], -0.1, 0.1),…
yoann
  • 311
  • 5
  • 17
1
vote
2 answers

How can I know if there is no Bias exists in a layer using caffe framwork with c++ program

I'm trying to read weight and bias in a caffe framework with c++. Here is my code shared_ptr >& weight = current_layer->blobs()[0];//for weights shared_ptr >& bias = current_layer->blobs()[1];//for bias But if for some model…
Ganesh M S
  • 1,073
  • 2
  • 13
  • 24
1
vote
3 answers

Are the bias terms added by default on each layer in tensorflow models?

Are the bias terms added by default when creating the tensorflow neural network models? To rephrase, if x is the input to a particular layer, y is the ouput, W is the weight matrix and b is the bias , then the output of the layer is given by, y…
Uzair Ahmed
  • 119
  • 1
  • 13
1
vote
1 answer

With bias, ANN not converge anymore

I'm learning ANN, I did two script (in fortran90 and python) for simple binary classification problem. I first did without bias, and I get a good convergence. But adding a bias for each node it does not converge anymore (or everything is going near…
Dadep
  • 2,796
  • 5
  • 27
  • 40
1
vote
0 answers

neural net: bias seems to be ignored

I coded a very simple neural net with 1 neuron and 2 inputs and 1 bias in java, trying to classify dots on either the left or right side of a line. The problem is that the neural net recognizes the slope of the line but not the y-intercept (e.g. the…
1
vote
2 answers

Find accuracy of neural network application result

I couldn't find anything useful about accuracy of results in neural network, I run character recognition example in Matlab, after network training and simulation by input test, how can I compute accuracy of output result after simulation? for some…
a1i
  • 43
  • 1
  • 7
1
vote
2 answers

Clarification on bias of a perceptron

Isn't it true that if a bias is not present, a line passing through origin should be able to linearly separate the two data sets?? But the most popular answer in this -->> question says y ^ …
suprith
  • 489
  • 4
  • 8
0
votes
0 answers

How the 'Test Exposure time' influence the Variance and bias in AB test

I got this question in an interview. The question is we would like to test a button on the checkout page. In general, we should enroll the users who visit the checkout page. However, if we enroll users as long as they visit our website. How it will…
0
votes
1 answer

how are important weights defined in a neural network?

So I have weights of a pretrained neural network but I'm kinda lost as to what each of the numbers mean. At all the neurons and at every layer of a netowrk, what do negative weights and positive weights mean? Does a weight that's away from 0 mean…
0
votes
0 answers

InvalidArgumentError: Matrix size-incompatible: In[0]: [256,3], In[1]: [65,1] [[{{node dense_51/BiasAdd}}]]

As I am new please help me resolve. I have been trying since months. Please ignore any small mistake and focus. Thanks in advance. I have been reshaping since I got this code now reached the bottom most layer but still getting this error mentioned…
0
votes
2 answers

How to get bias tensorflow?

import tensorflow as tf new_model = tf.keras.models.load_model('saved_model/my_model_KNOCK_2_RMS') new_model.get_weights() How can I retrieve the Bias matrix as I retrieve the weights? Or is there a different way to get the bias matrix?
0
votes
1 answer

How to decide bias in Hamiltonian Ising model? python

I am trying to code finance portfolio optimisation problem into a quantum annealer, using the Hamiltonian Ising model. I am using the dwave module neal.sampler.SimulatedAnnealingSampler.sample_ising I was wondering how one gets to decide what the…
Liza Darwesh
  • 401
  • 1
  • 3
  • 20
0
votes
1 answer

difference between initializing bias by nn.init.constant and (bias=1) in pytorch

I'm making a code for AlexNet and i'm confused with how to initialize the weights what is the difference between: for layer in self.cnnnet: if isinstance(layer, nn.Conv2d): nn.init.constant_(layer.bias,…
yessss
  • 15
  • 4
0
votes
2 answers

Number of neurons in dense layer in CNN

I want to ask you a question about number of neurons used in dense layers used in CNN. As much as i seen generally 16,32,64,128,256,512,1024,2048 number of neuron are being used in Dense layer. So is descending vs ascending order better before the…
0
votes
1 answer

The Bias in my Single Layer Perceptron doesn't work

Blockquote I am making a single layer perceptron that learns how to detect if a point is above or below a given line (it outputs results as a 1 or -1). It works fine when the line's y-intercept is 0 and there is no bias, but when I incorporate a…