Highest Voted 'bias-neuron' Questions

2

votes

1 answer

What is the best way to implement a bias node to my python/numpy neural network?

I built a numpy only neural network originally based on an online tutorial and have come to realise that I should have some kind of bias neuron. However I have really been struggling to figure out how to implement it into my code and would greatly…

numpy neural-network bias-neuron

asked Nov 22 '19 at 17:07

Ethicalfive

33
3

2

votes

1 answer

Adding bias to embedding layer in Keras

I'm building a model using keras in order to learn word embeddings using a skipgram with negative sampling. My input is pair of words: (context_word, target_word) and of course the label 1 for positives and 0 for negative couples. What I need to…

python keras embedding bias-neuron

asked Feb 10 '19 at 14:10

melowgs

420
1
4
13

2

votes

1 answer

Backprop and forward pass in neural networks

I am trying to design a simple a neural network but I am facing some problems. My output keeps converging to 0.5 when I use ReLU and to 0.7 when I use sigmoid function. Please suggest me : Is there any other way of initializing weights and biases ?…

machine-learning neural-network backpropagation gradient-descent bias-neuron

asked May 15 '18 at 05:04

pr22

179
1
2
9

2

votes

0 answers

Neural Network XOR not converging

I have tried to implement a neural network in Java by myslef to be an XOR-gate, it has kinda of worked. About ~20% of the time when I try to train it, the weights converges to produce a good enough output (RMS < 0.05) but the other 80% of the time…

neural-network backpropagation gradient-descent bias-neuron

asked Jul 16 '17 at 22:02

Lofen

21
3

2

votes

2 answers

get_all_param_values() how to read lasagne.layer

I am running Lasagne and Theano to create my Convolutional Neural Network. I currently consist of l_shape = lasagne.layers.ReshapeLayer(l_in, (-1, 3,130, 130)) l_conv1 = lasagne.layers.Conv2DLayer(l_shape, num_filters=32, filter_size=3,…

neural-network theano conv-neural-network lasagne bias-neuron

asked Feb 09 '16 at 00:54

jwin

21
2

2

votes

1 answer

In a Neural Network, should bias have a momentum term?

Should the momentum be added also to the bias term of every node in the network or preferably only on weights?

neural-network momentum bias-neuron

asked Feb 02 '16 at 09:42

user1861248

79
4

2

votes

1 answer

BackPropagation Neuron Network Approach - Design

I am trying to make a digit recognition program. I shall feed a white/black image of a digit and my output layer will fire the corresponding digit (one neuron shall fire, out of the 0 -> 9 neurons in the Output Layer). I finished implementing a…

machine-learning neural-network backpropagation bias-neuron

asked Dec 19 '15 at 23:57

user5348609

2

votes

1 answer

In neural networks, does a bias change the threshold of an activation function?

I have read some other questions (and related answers) about this, but I still have doubts: will adding a bias to a threshold activation function change the threshold? As far as I know, adding a bias should move the activation function along the…

artificial-intelligence neural-network threshold perceptron bias-neuron

asked May 17 '13 at 12:40

Andrea Tucci

187
2
8

1

vote

0 answers

How are biases adjusted in neural network?

I'm learning about neural networks. I saw many videos, PDFs etc telling about adjusting the weights in backpropagation. But nowhere i saw someone explaining how adjusting the biases work. Can anyone here give me a brief explanation on how the biases…

deep-learning neural-network bias-neuron

asked May 29 '22 at 20:14

Ruthvik

790
5
28

1

vote

1 answer

Train only bias in a pre-trained model from Keras-Tensorflow

Sounds strange, I know! but: Is possible train only the bias? I have pretrained models but applying low rank to the weights, obvously, the accurracy of the NN downs... Is there anyway to say Keras-TensoFlow compiler that only trains the bias?…

python tensorflow keras bias-neuron

asked Nov 25 '20 at 18:38

Diego Ruiz

187
2
11

1

vote

1 answer

Train bias in neural network as weighted sum of seperate inputs

I am currently trying to implement the min-max relevance model from page 217 in this paper:…

python keras neural-network bias-neuron

asked Aug 17 '20 at 16:30

Robin

81
5

1

vote

0 answers

How to get predicted values based on weights and bias in python

I am trying predict the output of test and train data using X_trainT and X_testT using predict() function. I'm getting below listed error - yPredTrain = predict(X_trainT, parameters) yPredTest = predict(X_testT, parameters) # This function is…

python numpy machine-learning train-test-split bias-neuron

asked May 31 '20 at 16:41

Neeraj Kumar

11
3

1

vote

0 answers

Model Overfits after adding bias

Implementation of 4bit up counter. First, I have implemented the model without using the bias term. the model seems to have worked correctly but after adding the bias term the model overfits at the very initial stage and the loss becomes zero. Even…

python neural-network training-data backpropagation bias-neuron

asked May 14 '20 at 18:11

shobhit

11
1

1

vote

1 answer

How is the bias node integrated in NEAT?

In NEAT you can add a special bias input node that is always active. Regarding the implementation of such a node there is not much information in the original paper. Now I want to know how the bias node should behave, if there is a at all a…

neural-network neat bias-neuron

asked May 04 '20 at 01:07

Tloy

11
3

1

vote

1 answer

I obtain the same output for every input data after training my neural network (2000 inputs, 1 output)

I am trying to implement a neural network which have around 2000 inputs. I have made some tests with the iris data set in order to check it and it seems to work, but when I am running my test it throws wrong results, most of the time, for all the…

python neural-network backpropagation dna-sequence bias-neuron

asked Jan 14 '19 at 17:49

Cristiam MJ

17
3

Questions tagged [bias-neuron]