Use this tag for programming-related questions about the softmax function, also known as the normalized exponential function. Questions specific to a certain programming language should also be tagged with that language.
Questions tagged [softmax]
534 questions
-1
votes
1 answer
Adding softmax significantly changes weight updates
I have a neural network of the form N = W1 * Tanh(W2 * I), where I is the Input Vector/Matrix. When I learn these weights the output has a certain form. However, when I add a normalization layer, for example, N' = Softmax( W1 * Tanh(W2 * I) )…
Rumu
- 403
- 1
- 3
- 10
-2
votes
1 answer
How to make a prediction using karas TensorFlow?
Ive coded this machine learning algoritm but it retured to me a wierd array. I want to input 2 numbers and then those numbers be clasified into similar results found in Y, How do I make a prediction using this model?
import numpy as np # mutivariate…
Kawith
- 1
- 2
-2
votes
1 answer
Dimension of gradients in backpropagation
Take a simple neural network that takes in data of dimension NxF, and output NxC where the N, F, and C represent number of samples, features, and C output neurons respectively. Needless to say, softmax function with cross-entropy is used given we…
VM_AI
- 1,132
- 4
- 13
- 25
-2
votes
1 answer
What is this function doing (softmax)
What is this "ih" and "ho" in this function . It is softmax activation function I am not able to understand the string check reason.
public double sim(double x, string layer)
{
// Determine max
double max = double.MinValue;
if…
stan.steve
- 111
- 10
-3
votes
1 answer
Which of the following options is true about Softmax Function?
S1 and S2 are two statements with respect to SoftMax function, Choose the correct option:
S1: It is a function that turns a vector of K real values into a vector of K real values resulting a sum equal to 1.
S2: It can be used in a classifier only…
Anupam Alok
- 1
- 2
-3
votes
1 answer
How do I preprocess my data when I have too much but need it all?
I am literally months out of college with a CS BS and my boss is having me build a machine learning agent to classify data into 23 categories from scratch all by myself in two months. I took a single Intro to AI class, and we didn't even cover…
tiffanie
- 89
- 8
-3
votes
1 answer
Softmax Implementation in C++
Folks,
Are there any example of the implementation of a simple softmax function for N values? I've seem things like "softmax-based detectors" and so forth, but I just want to see a pure, straightforward C++ softmax implementation.
Any examples you…
Pototo
- 691
- 1
- 12
- 27
-4
votes
1 answer
Can you describe how to apply SoftMax derivatives in generic terms for C++?
This question is regarding Softmax’s derivatives.
I looked around for SoftMax function and found this useful language agnostic resource:
Which Translates to C/C++ nicely.
void TransformToSoftMax(DoubleListType &inputs, DoubleListType &outputs, int…
Adrian E
- 29
- 6
-5
votes
1 answer
Terms in neural networks: what is annealing temperature parameter in a softmax activation function?
I’m reading this paper about sound separation by using neural network method. It uses the term "annealing the temperature parameter in a softmax activation function". What does it mean?
user11190123
- 1
- 2