Re-sampling procedures for reducing bias of error rate estimation in multinomial classification (Q1073508)

The bias in estimating the error rate of a multinomial classification problem is addressed. The cross-validation, jackknife and bootstrap procedures are introduced to obtain the bias-reducing estimates of error rate. The performance of these procedures is examined by Monte Carlo simulation under different population structures. It is found that all three procedures are effective in reducing bias under small sample situations.