The split value at the root node in a decision tree is chosen based on optimization criteria, not necessarily the median or mean. Decision trees aim to minimize impurity (for classification) or reduce variance/MSE (for regression).The algorithm evaluates all possible split points and selects the one that maximizes information gain or minimizes error.
Why a Decimal Value Instead of Whole Numbers?
- Even if your dataset contains only whole numbers, the tree considers midpoints between consecutive values as potential split points.
- For example, if your sorted values are {3, 5, 7, 9, 11, 13, ...}, the tree might evaluate splits at {4, 6, 8, 10, 12, ...}.
- The split at 9.5 means the algorithm found that separating values below 9.5 from those above 9.5 resulted in the best reduction in impurity or error.
In MATLAB, you can visualize the tree using:
view(SVModelTree, 'Mode', 'graph');
Refer the following documentation to learn more about the viewing options: https://www.mathworks.com/help/stats/view-decision-tree.html
