Can someone please show me how to do this on Weka? For some reason, when I do it, I get the same accuracy rate, especially for the 0.02 which gives me 100%. And even when I change the random seeds, I am not sure what is wrong. So if I can get a step-by-step guide for the first two training set sizes, that would be great.
Measure the impact of training set size on the accuracy and the size of the learned tree (no pruning, so use option -U) and use 60% of the data for testing. Consider training set sizes in the range of 0-40% (including at least the values 0.02, 0.1, 0.2, 0.3, and 0.4 for the training fractions). Because of the high variance due to random splits, repeat the experiment with ten different random seeds for each training set size. Then report the mean, maximum, and minimum accuracies at each training set size.
Turn in two plots, showing how accuracy varies with training set size.