About Softmax Calculator
This softmax calculator converts a list of scores (logits) into probabilities that add up to 1, and shows each step: subtract the maximum, exponentiate, sum and divide. It is free, needs no sign-up and runs in your browser, so nothing you enter is uploaded.
Softmax exponentiates every score and divides by the sum of the exponentials. Larger scores get disproportionately larger shares because of the exponential, and the probabilities always sum to 1. The page opens on the scores 2, 1 and 0.1, which give probabilities of about 0.66, 0.24 and 0.10.
The temperature divides the scores before the softmax. A temperature below 1 sharpens the distribution toward the largest score, and one above 1 flattens it toward equal probabilities. Language-model sampling uses exactly this knob. Subtracting the maximum first is the standard trick that prevents overflow without changing the answer.
How to use Softmax Calculator
- Choose a function from the menu, or "Compare all" to overlay the curves.
- For leaky ReLU, ELU and swish, set the extra parameter (alpha or beta) if you want something other than the default.
- Type an x to see f(x) and f'(x), and read the table of values.
- Zoom, pan and trace the plot to read the curve. Double-tap resets the view.
- For softmax, enter your scores separated by commas, set the temperature and read the probabilities and the steps.
- Read the strengths and weaknesses under the plot to compare the functions.
Features
- Nine activation functions with formulas and derivatives rendered in LaTeX.
- Interactive plot of the function and its derivative, with zoom, pan, trace and PNG download.
- A compare view of eight functions on one plot.
- Parameters for leaky ReLU (alpha), ELU (alpha) and swish (beta).
- GELU computed exactly with the error function, not the tanh approximation.
- Softmax with temperature and a worked, numerically stable calculation.
- A value table, range, and plain-language strengths and weaknesses for each function.
Worked examples
Scores 3, 1, 0.2, -1 at temperature 1, 0.5 and 3 gives 0.823, 0.111, 0.05, 0.015 / 0.978, 0.018, 0.004, 0 / 0.461, 0.237, 0.181, 0.121
At temperature 0.5 almost all the probability goes to the top score; at 3 the four probabilities are much closer together.
Privacy: how it works
- All calculations and plots run in your browser tab. Nothing is sent to Ulkaa or anyone else.
Tips
- Compare the derivative curves: where one is flat near zero, learning is slow in that region of input.
- Try a leaky ReLU with a large alpha such as 0.3 to see how the negative side tilts, and a swish beta of 5 to see it approach ReLU.
- For softmax, add 100 to every score: the probabilities do not change, because only the differences matter.
- Scores with one very large value give a probability close to 1 for that class, whatever the others are.
Frequently asked questions
Is it really free?
Yes. There is no price, no trial and no credit card. Ulkaa Tool does the work with your own device, so there is no server bill to pass on to you.
Do I need an account?
No. There is no sign-up and no login. Open the page and use it. An Ulkaa account is not needed for anything on this tool.
Does it run in my browser?
Yes. Your inputs are processed by code running in your browser tab, on your own device.
Is my data uploaded?
No. Your inputs are never sent to Ulkaa or to anyone else. You can check this yourself by watching the Network tab in your browser developer tools while you use the tool.
How do I calculate softmax by hand?
Compute e to the power of each score, add them up, and divide each exponential by the sum.
Why subtract the maximum before softmax?
It prevents overflow for large scores, and because softmax depends only on differences between scores the result is identical.
What does temperature do in softmax?
It scales the scores before the exponential. Low temperature gives a peaked distribution and high temperature a flat one.
More Activation Function Plotter pages
- Activation Function PlotterPlot any activation function and its derivative, evaluate it at a point, or turn scores into softmax probabilities.
- Sigmoid Function CalculatorEvaluate the logistic sigmoid and its derivative at any x, and plot both.
- Tanh Function CalculatorEvaluate tanh and its derivative at any x, and plot both.
- ReLU Activation FunctionPlot max(0, x) and its derivative and evaluate them at any input.
- Leaky ReLU CalculatorSet the negative slope alpha and see how leaky ReLU differs from ReLU.
- ELU Activation FunctionPlot the exponential linear unit and its derivative for any alpha.
- GELU Activation FunctionPlot the Gaussian error linear unit and its derivative, and evaluate it at any x.
- Swish (SiLU) Activation FunctionPlot x times sigmoid(beta x) and its derivative, and change beta.
- Softplus Function CalculatorPlot softplus and its derivative, which is exactly the sigmoid.