0

I'm trying to make sure I understand how my cost function is working as my model doesn't seem to be great so I've taken the cost from one mini-batch and tried to manually calculate it to see if I get the same cost. The cost given by Tensorflow is 0.48568. But in my manual attempt below I am getting 0.2109.

As a side note I referred to this to help me figure out the manual calcs.

Manual Calcs

Reddspark
  • 6,934
  • 9
  • 47
  • 64
  • By the way, you don't need to use softmax when doing binary classification. You can just use a logistic loss. – Aaron Aug 25 '17 at 02:14

1 Answers1

0

Ok I figured it out! I was using log to the base 10 in my calcs (Excel default). When infact it needs to be log to the base e (ln function).

Reddspark
  • 6,934
  • 9
  • 47
  • 64