Questions tagged [feed-forward]
112 questions
11
votes
4 answers
Training feedforward neural network for OCR
Currently I'm learning about neural networks and I'm trying to create an application that can be trained to recognize handwritten characters.
For this problem I use a feed-forward neural network and it seems to work when I train it to recognize 1,…

Marnix v. R.
- 1,638
- 4
- 22
- 33
10
votes
1 answer
Should an input layer include a bias neuron?
I was wondering: in a multi-layer feed-forward neural network should the input layer include a bias neuron, or this is just useful in hidden layers? If so, why?

tunnuz
- 23,338
- 31
- 90
- 128
6
votes
1 answer
Keras LSTM state vs. feed forward network with sliding window
In the default mode (stateful = False) in Keras' LSTM implementation, all samples in a batch are independent and the state is not propagated from one sample to the next. As per my understanding, input sequence length (L) is the only way to have the…

artemis
- 581
- 1
- 4
- 13
5
votes
1 answer
Neural network gives different results for each execution
This is the exact code I'm running with Keras and TensorFlow as a back end. For each run with the same program, the training results are different. Some times it gets 100% accuracy in 400th iteration and some times in the 200th.
training_data =…

Nirojan Selvanathan
- 10,066
- 5
- 61
- 82
5
votes
1 answer
Neural Network implementation in java
I am attempting to implement a FFNN in Java with backpropagation and have no idea what I am doing wrong. It worked when I had only a single neuron in the network, but I wrote another class to handle larger networks and nothing converges. It seems…

Nate Young
- 96
- 5
4
votes
2 answers
Implementing a Neural Network in Java: Training and Backpropagation issues
I'm trying to implement a feed-forward neural network in Java.
I've created three classes NNeuron, NLayer and NNetwork. The "simple" calculations seem fine (I get correct sums/activations/outputs), but when it comes to the training process, I don't…

maddouri
- 3,737
- 5
- 29
- 51
4
votes
1 answer
Feed forward ANN stuck at testing accuracy 42% for MNIST images
I am using a primitive neural network on the mnist dataset, however my mode gets stuck at 42% of accuracy for the validation data.
The data is csv, with the format being: 60000 rows (for training data) and 785 columns, the first one being the…

NeuroEng
- 191
- 8
4
votes
4 answers
Ideal Input In Neural Network For The Game Checkers
I'm designing a feed forward neural network learning how to play the game checkers.
For the input, the board has to be given and the output should give the probability of winning versus losing. But what is the ideal transformation of the checkers…

Asqan
- 4,319
- 11
- 61
- 100
4
votes
1 answer
PyBrain how to interpret the results from net.activate?
I've trained a network on PyBrain for purpose of classification and am ready to fire away with specific input. However, when I do
classes = ['apple', 'orange', 'peach', 'banana']
data = ClassificationDataSet(len(input), 1,…

user1330974
- 2,500
- 5
- 32
- 60
3
votes
1 answer
Tensorflow error: Failed to convert object of type to Tensor
I am trying to code a neural network which can recognize handwritten digits. I am using the MNIST dataset and the tensor flow library. For now, I am only trying to train the network but it throws a huge error whenever I run it. I am a beginner, so I…

LeoTheDev
- 60
- 1
- 7
3
votes
2 answers
My neural net learns sin x but not cos x
I have build my own neural net and I have a weird problem with it.
The net is quite a simple feed-forward 1-N-1 net with back propagation learning. Sigmoid is used as activation function.
My training set is generated with random values between [-PI,…

Simo Erkinheimo
- 1,347
- 9
- 17
2
votes
0 answers
What happens if you missconfigure a feedforwardnetwork as "feedforward = false"
In Python NEAT you can create Feedforward-Networks or Recurrent-Networks, but you can also configure the binary setting for Feedforward in the config-file.
Now i'm uncertain what a Feedforward network with disabled feedforward would process.
If…

JavaJawa
- 45
- 5
2
votes
1 answer
Why listing model components in pyTorch is not useful?
I am trying to create Feed forward neural networks with N layers
So idea is suppose If I want 2 inputs 3 hidden and 2 outputs than I will just pass [2,3,2] to neural network class and neural network model will get created so if I want…

ganesh
- 171
- 1
- 2
- 13
2
votes
1 answer
fmap with two functions
Im writing a neural network using haskell. Im basing my code on this http://www-cs-students.stanford.edu/~blynn/haskell/brain.html .
I adapted the feedforward method in the following way:
feedForward :: [Float] -> [([Float], [[Float]])] ->…

nat
- 85
- 6
2
votes
0 answers
I always predict negative values with my model
I'm doing a regression problem and I have 18 features. Whenever I try to predict the values, it always gives me negative values. Can anybody help?
I define my NN to be this:
features = Input(shape=(18,))
LAYER1
X = Dense(1024)(features)
X =…

Pocholo Mendiola
- 21
- 2