0

Suppose we have a standard autoencoder with three layers (i.e. L1 is the input layer, L3 the output layer with #input = #output = 100 and L2 is the hidden layer (50 units)). I know the interesting part of an autoencoder is the hidden part L2. Instead of passing 100 inputs to my supervised model, it will feed it with 50 inputs. What is the optimal hidden units size? 50 is well, but why not using 51, 52 or 63 hidden units? Does 51 will perform better the supervised model than 50 hidden units?

Suppose now that the number of inputs is 1,000,000. If N is the number of units, then I don't want to test out each possible value for N to find out the optimal N. I thought there exists at least an algorithm to do not be obligated to test each possible value or eliminate some of them.

Could that question help?

Jeremie
  • 405
  • 1
  • 7
  • 20
  • 1
    There's no universal answer. The way to find out is to try different values and pick the one that works the best on your dev set. – k_ssb May 09 '18 at 01:29

1 Answers1

3

There is no rule for it. number of Hidden layer selection is purely based on hit and trial.

abhi
  • 87
  • 7