Skip to Main Content
Table 7: 
RMSE (lower is better) and correlation results of our metrics in our STS and SICK investigations. RMSE (quant): RMSE on empirical quantile distribution with quantiles 0.1, 0.2, … ,0.9.
RMSERMSE (quant)Pearson’s ρSpearman’s ρ
tasksbsms2msbsms2msbsms2msbsms2m
STS 0.34 0.25 0.25 0.25 0.11 0.10 0.52 0.55 0.55 0.51 0.53 0.53 
SICK 0.38 0.25 0.24 0.32 0.14 0.13 0.62 0.64 0.64 0.66 0.66 0.66 
RMSERMSE (quant)Pearson’s ρSpearman’s ρ
tasksbsms2msbsms2msbsms2msbsms2m
STS 0.34 0.25 0.25 0.25 0.11 0.10 0.52 0.55 0.55 0.51 0.53 0.53 
SICK 0.38 0.25 0.24 0.32 0.14 0.13 0.62 0.64 0.64 0.66 0.66 0.66 
Close Modal

or Create an Account

Close Modal
Close Modal