M-State (2)

LA home
Computing
MML
 Glossary
 Discrete
  <m-state(1)<
  m-state(2)
  >Integers>

  >Fisher>

The Fisher information for the M-state distribution, i.e. M-1 parameters, T=<T1,...TM-1>, define TM=1-T1-...-TM-1. The Fisher, F(T), is the following determinant:

  |
  |
  |
  |
  |
  |
  |
N/T1+N/TM    N/TM    ...      N/TM
  N/TM     N/T2+N/TM ...      ...
  N/TM       N/TM    ...      ...
  ...        ...     ...      ...
  N/TM       ...     ...   N/TM-1+N/TM
|
|
|
|
|
|
|
Take a factor of N out of every row:
  |
  |
  |
= |
  |
  |
  |
1/T1+1/TM    1/TM    ...    1/TM
  1/TM    1/T2+1/TM  ...    1/TM
  1/TM       1/TM    ...
  ...
  1/TM                    1/TM-1+1/TM
|
|
|
|
|
|
|
.NM-1
Subtract column one from the other rows:
  |
  |
  |
= |
  |
  |
  |
1/T1+1/TM    -1/T1   -1/T1  ...  -1/T1
  1/TM       1/T2      0           0
  1/TM        0      1/T3   ...    0
  ...
  1/TM        0        0    ...  1/TM-1
|
|
|
|
|
|
|
.NM-1
For each row, take a factor of 1/Ti out of row i:
  |
  |
  |
= |
  |
  |
  |
1+T1/TM      -1      -1     ...   -1
 T2/TM        1       0     ...    0
 T3/TM        0       1     ...    0
 ...
TM-1/TM       0       0            1
|
|
|
|
|
|
|
    NM-1
.--------
 T1...TM-1
Now add row 2 and row 3 and ... and row M-1 to row 1 which removes the `-1's from row 1 and makes the top left element into:
  (1 + T1/TM + T2/TM + ... + TM-1/TM)

= (TM + T1 + T2 + ... + TM-1)/TM

= 1/TM

Consequently the Fisher is   NM-1/(T1...TM).

www #ad:

↑ © L. Allison, www.allisons.org/ll/   (or as otherwise indicated).
Created with "vi (Linux)",  charset=iso-8859-1,   fetched Wednesday, 24-Apr-2024 08:54:53 UTC.

Free: Linux, Ubuntu operating-sys, OpenOffice office-suite, The GIMP ~photoshop, Firefox web-browser, FlashBlock flash on/off.