Questions tagged [feed-forward]

112 questions
11
votes
4 answers

Training feedforward neural network for OCR

Currently I'm learning about neural networks and I'm trying to create an application that can be trained to recognize handwritten characters. For this problem I use a feed-forward neural network and it seems to work when I train it to recognize 1,…
10
votes
1 answer

Should an input layer include a bias neuron?

I was wondering: in a multi-layer feed-forward neural network should the input layer include a bias neuron, or this is just useful in hidden layers? If so, why?
tunnuz
  • 23,338
  • 31
  • 90
  • 128
6
votes
1 answer

Keras LSTM state vs. feed forward network with sliding window

In the default mode (stateful = False) in Keras' LSTM implementation, all samples in a batch are independent and the state is not propagated from one sample to the next. As per my understanding, input sequence length (L) is the only way to have the…
artemis
  • 581
  • 1
  • 4
  • 13
5
votes
1 answer

Neural network gives different results for each execution

This is the exact code I'm running with Keras and TensorFlow as a back end. For each run with the same program, the training results are different. Some times it gets 100% accuracy in 400th iteration and some times in the 200th. training_data =…
Nirojan Selvanathan
  • 10,066
  • 5
  • 61
  • 82
5
votes
1 answer

Neural Network implementation in java

I am attempting to implement a FFNN in Java with backpropagation and have no idea what I am doing wrong. It worked when I had only a single neuron in the network, but I wrote another class to handle larger networks and nothing converges. It seems…
4
votes
2 answers

Implementing a Neural Network in Java: Training and Backpropagation issues

I'm trying to implement a feed-forward neural network in Java. I've created three classes NNeuron, NLayer and NNetwork. The "simple" calculations seem fine (I get correct sums/activations/outputs), but when it comes to the training process, I don't…
maddouri
  • 3,737
  • 5
  • 29
  • 51
4
votes
1 answer

Feed forward ANN stuck at testing accuracy 42% for MNIST images

I am using a primitive neural network on the mnist dataset, however my mode gets stuck at 42% of accuracy for the validation data. The data is csv, with the format being: 60000 rows (for training data) and 785 columns, the first one being the…
NeuroEng
  • 191
  • 8
4
votes
4 answers

Ideal Input In Neural Network For The Game Checkers

I'm designing a feed forward neural network learning how to play the game checkers. For the input, the board has to be given and the output should give the probability of winning versus losing. But what is the ideal transformation of the checkers…
4
votes
1 answer

PyBrain how to interpret the results from net.activate?

I've trained a network on PyBrain for purpose of classification and am ready to fire away with specific input. However, when I do classes = ['apple', 'orange', 'peach', 'banana'] data = ClassificationDataSet(len(input), 1,…
user1330974
  • 2,500
  • 5
  • 32
  • 60
3
votes
1 answer

Tensorflow error: Failed to convert object of type to Tensor

I am trying to code a neural network which can recognize handwritten digits. I am using the MNIST dataset and the tensor flow library. For now, I am only trying to train the network but it throws a huge error whenever I run it. I am a beginner, so I…
3
votes
2 answers

My neural net learns sin x but not cos x

I have build my own neural net and I have a weird problem with it. The net is quite a simple feed-forward 1-N-1 net with back propagation learning. Sigmoid is used as activation function. My training set is generated with random values between [-PI,…
2
votes
0 answers

What happens if you missconfigure a feedforwardnetwork as "feedforward = false"

In Python NEAT you can create Feedforward-Networks or Recurrent-Networks, but you can also configure the binary setting for Feedforward in the config-file. Now i'm uncertain what a Feedforward network with disabled feedforward would process. If…
JavaJawa
  • 45
  • 5
2
votes
1 answer

Why listing model components in pyTorch is not useful?

I am trying to create Feed forward neural networks with N layers So idea is suppose If I want 2 inputs 3 hidden and 2 outputs than I will just pass [2,3,2] to neural network class and neural network model will get created so if I want…
ganesh
  • 171
  • 1
  • 2
  • 13
2
votes
1 answer

fmap with two functions

Im writing a neural network using haskell. Im basing my code on this http://www-cs-students.stanford.edu/~blynn/haskell/brain.html . I adapted the feedforward method in the following way: feedForward :: [Float] -> [([Float], [[Float]])] ->…
nat
  • 85
  • 6
2
votes
0 answers

I always predict negative values with my model

I'm doing a regression problem and I have 18 features. Whenever I try to predict the values, it always gives me negative values. Can anybody help? I define my NN to be this: features = Input(shape=(18,)) LAYER1 X = Dense(1024)(features) X =…
1
2 3 4 5 6 7 8