Skip to Main Content
Table 2: 
Instructions and examples shown to raters. Raters indicated their responses using a sliding bar which ranged from −50 to 50. In the instructions actually shown, the examples were shown alongside a sliding bar reflecting the desired rating. Exact UI not shown for compactness.
For each pair of sentences, assume that the first sentence (S1) is true, describes a real scenario, or expresses an opinion. Using your best judgment, indicate how likely it is that the second sentence (S2) is also true, describes the same scenario, or expresses the same opinion. If either sentence is not interpretable, check the “Does Not Make Sense” box. Several examples are given below. 
Example 1: In the below example, the slider is far to the right because we can be very confident that if a person is “ 
S1: A woman is on a beach with her feet in the water. 
S2: The woman is outside. 
Example 2: In the below example, the slider is far to the left because we can be very confident that if a person is “on a beach” then that person is NOT “in her living room”. 
S1: A woman is on a beach with her feet in the water. 
S2: The woman is in her living room. 
Example 3: In the below example, the slider is in the center because knowing that woman is on the beach does not give us any information about the color of her hair and so we cannot reasonably make a judgment about whether or not her hair is brown. 
S1: A woman is on a beach with her feet in the water. 
S2: The woman has brown hair. 
For each pair of sentences, assume that the first sentence (S1) is true, describes a real scenario, or expresses an opinion. Using your best judgment, indicate how likely it is that the second sentence (S2) is also true, describes the same scenario, or expresses the same opinion. If either sentence is not interpretable, check the “Does Not Make Sense” box. Several examples are given below. 
Example 1: In the below example, the slider is far to the right because we can be very confident that if a person is “ 
S1: A woman is on a beach with her feet in the water. 
S2: The woman is outside. 
Example 2: In the below example, the slider is far to the left because we can be very confident that if a person is “on a beach” then that person is NOT “in her living room”. 
S1: A woman is on a beach with her feet in the water. 
S2: The woman is in her living room. 
Example 3: In the below example, the slider is in the center because knowing that woman is on the beach does not give us any information about the color of her hair and so we cannot reasonably make a judgment about whether or not her hair is brown. 
S1: A woman is on a beach with her feet in the water. 
S2: The woman has brown hair. 
Close Modal

or Create an Account

Close Modal
Close Modal