About Information Gain Calculator
This information gain calculator builds a one-split tree with entropy on the play-tennis data, showing the entropy before and after and the gain. It is free, needs no sign-up and runs in your browser, so nothing you enter is uploaded.
Entropy measures how mixed a node is, in bits. The root has 9 yes and 5 no rows, so its entropy is -(9/14)log2(9/14) - (5/14)log2(5/14) = 0.940. After splitting by outlook the children have entropies of 0, 0.971 and 0.971, weighted by 4, 5 and 5 rows out of 14, which averages 0.693. The information gain is the difference, 0.247 bits.
The gain is shown in the result panel as the root information gain. Information gain favours columns with many values, which is why trees on data with an ID column look suspiciously good.
How to use Information Gain Calculator
- Pick a sample dataset, or paste your own CSV with a header row.
- Choose the target column, the one you want to predict. It should have a handful of classes.
- Choose Gini impurity or entropy, and set the maximum depth and the minimum number of rows needed to split a node.
- Set a test share, for example 20%, to hold some rows back and measure accuracy on unseen data.
- Read the accuracy figures, then look at the tree. Tap a box to fold its branch, or scroll sideways on a small screen.
- Check the feature importance chart, and open the rules to copy the tree as text.
Features
- Numeric columns split on a threshold; text columns get one branch per value.
- Gini impurity or entropy as the split quality measure.
- Maximum depth, minimum rows to split and a repeatable train and test split.
- A tree diagram in responsive SVG with foldable branches, scrollable on phones.
- Feature importance as the share of total impurity reduction.
- Root impurity and information gain, so you can check a textbook calculation.
- The tree as if-then rules, which you can copy.
- Iris, a Titanic subset and play-tennis built in, with their sources stated.
Entropy and information gain
The gain is the entropy of the parent minus the weighted average entropy of the children.
Entropy = - sum of p_k log2(p_k)
Gain = Entropy(parent) - sum of (n_child / n) x Entropy(child)Worked examples
Play tennis, entropy, depth 1 gives root entropy 0.94, gain 0.247
The best split is outlook.
Privacy: how it works
- Your CSV is parsed and the tree is grown in your browser tab. Nothing is sent to Ulkaa or anyone else.
Tips
- Remove ID columns, names and anything that would not be known when you need to predict.
- Compare Gini and entropy on your data. They usually pick the same splits and differ only in the details.
- Fold the branches of a big tree and read the top levels first. Those hold the strongest signals.
- The test split is random but repeatable, so the same settings always give the same numbers.
Frequently asked questions
Is it really free?
Yes. There is no price, no trial and no credit card. Ulkaa Tool does the work with your own device, so there is no server bill to pass on to you.
Do I need an account?
No. There is no sign-up and no login. Open the page and use it. An Ulkaa account is not needed for anything on this tool.
Does it run in my browser?
Yes. Your CSV data are processed by code running in your browser tab, on your own device.
Is my data uploaded?
No. Your CSV data are never sent to Ulkaa or to anyone else. You can check this yourself by watching the Network tab in your browser developer tools while you use the tool.
What is information gain?
The reduction in entropy after splitting on a feature: the parent's entropy minus the weighted average entropy of the child nodes.
Why does information gain prefer many-valued columns?
A column with many values splits the rows into many small, nearly pure groups, which looks like a big gain even though it will not generalise. Gain ratio corrects for this.
More Decision Tree Builder pages
- Decision Tree BuilderPaste a CSV, choose the column to predict and watch a decision tree grow, split by split.
- Play Tennis Decision TreeThe textbook 14-day table, turned into a tree with entropy and information gain.
- Titanic Survival Decision TreePredict who survived from class, sex and age with a small, readable tree.
- Gini Impurity CalculatorSee the Gini impurity of a node and of its children after the best split.
- Decision Tree Feature ImportanceRank the columns of your data by how much a tree depends on them.
- Decision Tree OverfittingGrow an unrestricted tree and compare its training and test accuracy.
- Entropy vs Gini in a Decision TreeSwitch between the two split criteria and compare the trees they build.