simpler models tend to be preferred this chapter deals with comparing explanatory value of a model and its complexity there are two general families: regularization use a scoring mechanism like information criteria this chapter introduces information theory to cover these metrics 6.