From: Maximum likelihood estimation of reviewers' acumen in central review setting: categorical data
 |  |  | Observer 1 |  | |
---|---|---|---|---|---|
 | Observed Response | 1 | 2 | 3 | 4 |
True Response | 1 | 0.87 | 0.13 | 0 | 0 |
 | 2 | 0.03 | 0.88 | 0.09 | 0 |
 | 3 | 0 | 0.03 | 0.9 | 0.07 |
 | 4 | 0.01 | 0.05 | 0.07 | 0.87 |
 |  |  | Observer 2 |  | |
 | Observed Response | 1 | 2 | 3 | 4 |
True Response | 1 | 0.79 | 0.21 | 0 | 0 |
 | 2 | 0.05 | 0.65 | 0.3 | 0 |
 | 3 | 0 | 0 | 0.61 | 0.39 |
 | 4 | 0.01 | 0.07 | 0.04 | 0.89 |
 |  |  | Observer 3 |  | |
 | Observed Response | 1 | 2 | 3 | 4 |
True Response | 1 | 0.92 | 0.07 | 0.01 | 0 |
 | 2 | 0.04 | 0.83 | 0.13 | 0 |
 | 3 | 0 | 0.22 | 0.39 | 0.39 |
 | 4 | 0.1 | 0.08 | 0 | 0.81 |
 |  |  | Observer 4 |  | |
 | Observed Response | 1 | 2 | 3 | 4 |
True Response | 1 | 0.88 | 0.12 | 0 | 0 |
 | 2 | 0.05 | 0.76 | 0.14 | 0.06 |
 | 3 | 0 | 0 | 0.8 | 0.2 |
 | 4 | 0.03 | 0.26 | 0.1 | 0.62 |
 |  |  | Observer 5 |  | |
 | Observed Response | 1 | 2 | 3 | 4 |
True Response | 1 | 0.92 | 0.07 | 0.02 | 0 |
 | 2 | 0.19 | 0.63 | 0.18 | 0 |
 | 3 | 0 | 0.27 | 0.55 | 0.18 |
 | 4 | 0 | 0 | 0.01 | 0.98 |