Standard deviation of different methods when coping with missing values.
# annotators . | observed . | missing % . | σ( VL ) . | σ( IL ) . | σ( PL ) . | σ( RM ) . |
---|---|---|---|---|---|---|
6 | 0.567 | 25% | 0.073 | 0.077 | 0.089 | 0.285 |
6 | 0.567 | 12.5% | 0.050 | 0.051 | 0.061 | 0.230 |
6 | 0.567 | 4% | 0.028 | 0.029 | 0.034 | 0.100 |
3 | 0.905 | 10% | 0.031 | 0.036 | 0.038 | 0.058 |
3 | 0.476 | 5% | 0.040 | 0.051 | 0.041 | 0.058 |
# annotators . | observed . | missing % . | σ( VL ) . | σ( IL ) . | σ( PL ) . | σ( RM ) . |
---|---|---|---|---|---|---|
6 | 0.567 | 25% | 0.073 | 0.077 | 0.089 | 0.285 |
6 | 0.567 | 12.5% | 0.050 | 0.051 | 0.061 | 0.230 |
6 | 0.567 | 4% | 0.028 | 0.029 | 0.034 | 0.100 |
3 | 0.905 | 10% | 0.031 | 0.036 | 0.038 | 0.058 |
3 | 0.476 | 5% | 0.040 | 0.051 | 0.041 | 0.058 |