Strict MML (SMML)

LA home
Computing
MML
 Glossary
 SMML
  Binomial

Strict Minimum Message Length (SMML) inference (Wallace & Boulton 1975) constructs a mapping from the data space to the set of models (parameters) so as to minimise the expected length of a two-part message:  ‘model; (data|model)’. Note that the mapping defines a partition of the data space, each part being the data values that map to a particular model (parameter value). SMML estimators are, in an important sense, as good as it is possible to be (Wallace 1989, 1996).

SMML is invariant and consistent, and handles model selection, parameter estimation and hypothesis testing. Unfortunately SMML inference is NP-hard for most problems, although a polynomial-time algorithm exists for the Binomial distribution (Farr & Wallace 1997, 2002). Fortunately, MML (Wallace & Boulton 1968, Wallace & Freeman 1987) is a feasible approximation to SMML.

www:


© L. Allison   http://www.allisons.org/ll/   (or as otherwise indicated),
Created with "vi (Linux or Solaris)",  charset=iso-8859-1,  fetched Friday, 24-Nov-2017 04:27:42 EST.

free: Linux, Ubuntu operating-sys, OpenOffice office-suite, The GIMP ~photoshop,
Firefox web-browser, FlashBlock flash on/off.