TY - JOUR
T1 - A Comparative Study of Information Criteria for Model Selection
AU - Nakamura, T.
AU - Judd, Kevin
AU - Mees, A.I.
AU - Small, M.
PY - 2006
Y1 - 2006
N2 - To build good models, we need to know the appropriate model size. To handle this problem, a variety of information criteria have already been proposed, each with a different background. In this paper, we consider the problem of model selection and investigate the performance of a number of proposed information criteria and whether the assumption to obtain the formulae that fitting errors are normally distributed hold or not in some conditions (different data points and noise levels). The results show that although the application of information criteria prevents over-fitting and under-fitting in most cases, there are cases where we cannot avoid even involving many data points and low noise levels in ideal situations. The results also show that the distribution of the fitting errors is not always normally distributed, although the observational noise is Gaussian, which contradicts an assumption of the information criteria.
AB - To build good models, we need to know the appropriate model size. To handle this problem, a variety of information criteria have already been proposed, each with a different background. In this paper, we consider the problem of model selection and investigate the performance of a number of proposed information criteria and whether the assumption to obtain the formulae that fitting errors are normally distributed hold or not in some conditions (different data points and noise levels). The results show that although the application of information criteria prevents over-fitting and under-fitting in most cases, there are cases where we cannot avoid even involving many data points and low noise levels in ideal situations. The results also show that the distribution of the fitting errors is not always normally distributed, although the observational noise is Gaussian, which contradicts an assumption of the information criteria.
U2 - 10.1142/S0218127406015982
DO - 10.1142/S0218127406015982
M3 - Article
VL - 16
SP - 2153
EP - 2175
JO - International Journal of Bifurcation and Chaos
JF - International Journal of Bifurcation and Chaos
SN - 0218-1274
IS - 8
ER -