The Future Relations dataset used to test model calibration over future years. The three columns represent queries whose answers, intuitively, change frequently or every year, rarely or once every few years, and never. The top section includes queries whose answer is a US city, while the bottom section includes queries whose answer is a country.
| Frequent . | Rare . | Never . |
|---|---|---|
| Cities | ||
| The Super Bowl will take place in _X_. | Visa Inc.’s headquarters are located in _X_. | South by Southwest will take place in _X_. |
| The NCAA Men’s Final Four will take place in _X_. | SEGA of America’s headquarters are located in _X_. | Lollapalooza will take place in _X_. |
| The first game of the World Series will take place in _X_. | Barack Obama lives in _X_. | Summerfest will take place in _X_. |
| The US PGA Championship will take place in _X_. | Hillary Clinton lives in _X_. | Outside Lands will take place in _X_. |
| The golf US Open will take place in _X_. | Donald Trump works in _X_. | Spoleto Festival USA will take place in _X_. |
| The NBA all-star game will take place in _X_. | The Chargers play their home games in _X_. | CMA Music Festival will take place in _X_. |
| The NFL Draft will take place in _X_. | The Raiders play their home games in _X_. | Made in America Festival will take place in _X_. |
| The Netroots Nation conference will take place in _X_. | The Rams play their home games in _X_. | The US Open Tennis Championships will take place in _X_. |
| The MLB all-star game will take place in _X_. | General Electric’s headquarters are located in _X_. | The Masters tournament will take place in _X_. |
| The team from _X_ won the NBA championship. | Toyota’s US headquarters are located in _X_. | The Kentucky Derby will take place in _X_. |
| The team from _X_ won the Stanley Cup. | Nestle’s headquarters are located in _X_. | The capital of Washington state is _X_. |
| The team from _X_ won the World Series. | Tesla’s headquarters are located in _X_. | The capital of California state is _X_. |
| The team from _X_ won the Super Bowl. | Lebron James plays in _X_. | The capital of Texas is _X_. |
| The golf US Women’s Open will take place in _X_. | Tom Brady plays in _X_. | The capital of Florida is _X_. |
| Wrestlemania will take place in _X_. | Kevin Durant plays in _X_. | The Space Needle is located in _X_. |
| Stephen Curry plays in _X_. | The Statue of Liberty is located in _X_. | |
| Sidney Crosby plays in _X_. | Golden Gate Bridge is located in _X_. | |
| Mike Trout plays in _X_. | The White House is located in _X_. | |
| The Democratic National Convention will next take place in _X_. | The Liberty Bell is located in _X_. | |
| The Republican National Convention will next take place in _X_. | ||
| Countries | ||
| The Six Nations Championship will be held in _X_. | The UN Secretary general is from _X_. | The Oxford Literary Festival will take place in _X_. |
| The Association for Computational Linguistics will meet in _X_. | The Pope hails from _X_. | Wimbledon will take place in _X_. |
| The Neural Information Processing Systems conference will be held in _X_. | The FIFA world cup was lest held in _X_. | Tomorrowland will take place in _X_. |
| The Palme d’Or winner is from _X_. | The Cricket world cup was last held in _X_. | Hajj will take place in _X_. |
| The Tour De France winner is from _X_. | The UEFA European Football Championship was last held in _X_. | The Eiffel Tower is located in _X_. |
| The Wimbledon Men’s Singles winner is from _X_. | The Olympics were last held in _X_. | The Taj Mahal is located in _X_. |
| The UEFA Champions League final will take place in _X_. | The Winter Olympics were last held in _X_. | Burj Khalifa is located in _X_. |
| The G20 summit will be held in _X_. | The FIFA world cup was last won by _X_. | Machu Picchu is located in _X_. |
| The G7 summit will be held in _X_. | The Cricket world cup was last won by _X_. | Stonehenge is located in _X_. |
| The United Nations Climate Change conference will take place in _X_. | _X_ won the most gold medals in the last Olympics. | The world’s largest country by land area is _X_. |
| The world’s longest river is in _X_. | ||
| The world’s tallest mountain is in _X_. | ||
| Frequent . | Rare . | Never . |
|---|---|---|
| Cities | ||
| The Super Bowl will take place in _X_. | Visa Inc.’s headquarters are located in _X_. | South by Southwest will take place in _X_. |
| The NCAA Men’s Final Four will take place in _X_. | SEGA of America’s headquarters are located in _X_. | Lollapalooza will take place in _X_. |
| The first game of the World Series will take place in _X_. | Barack Obama lives in _X_. | Summerfest will take place in _X_. |
| The US PGA Championship will take place in _X_. | Hillary Clinton lives in _X_. | Outside Lands will take place in _X_. |
| The golf US Open will take place in _X_. | Donald Trump works in _X_. | Spoleto Festival USA will take place in _X_. |
| The NBA all-star game will take place in _X_. | The Chargers play their home games in _X_. | CMA Music Festival will take place in _X_. |
| The NFL Draft will take place in _X_. | The Raiders play their home games in _X_. | Made in America Festival will take place in _X_. |
| The Netroots Nation conference will take place in _X_. | The Rams play their home games in _X_. | The US Open Tennis Championships will take place in _X_. |
| The MLB all-star game will take place in _X_. | General Electric’s headquarters are located in _X_. | The Masters tournament will take place in _X_. |
| The team from _X_ won the NBA championship. | Toyota’s US headquarters are located in _X_. | The Kentucky Derby will take place in _X_. |
| The team from _X_ won the Stanley Cup. | Nestle’s headquarters are located in _X_. | The capital of Washington state is _X_. |
| The team from _X_ won the World Series. | Tesla’s headquarters are located in _X_. | The capital of California state is _X_. |
| The team from _X_ won the Super Bowl. | Lebron James plays in _X_. | The capital of Texas is _X_. |
| The golf US Women’s Open will take place in _X_. | Tom Brady plays in _X_. | The capital of Florida is _X_. |
| Wrestlemania will take place in _X_. | Kevin Durant plays in _X_. | The Space Needle is located in _X_. |
| Stephen Curry plays in _X_. | The Statue of Liberty is located in _X_. | |
| Sidney Crosby plays in _X_. | Golden Gate Bridge is located in _X_. | |
| Mike Trout plays in _X_. | The White House is located in _X_. | |
| The Democratic National Convention will next take place in _X_. | The Liberty Bell is located in _X_. | |
| The Republican National Convention will next take place in _X_. | ||
| Countries | ||
| The Six Nations Championship will be held in _X_. | The UN Secretary general is from _X_. | The Oxford Literary Festival will take place in _X_. |
| The Association for Computational Linguistics will meet in _X_. | The Pope hails from _X_. | Wimbledon will take place in _X_. |
| The Neural Information Processing Systems conference will be held in _X_. | The FIFA world cup was lest held in _X_. | Tomorrowland will take place in _X_. |
| The Palme d’Or winner is from _X_. | The Cricket world cup was last held in _X_. | Hajj will take place in _X_. |
| The Tour De France winner is from _X_. | The UEFA European Football Championship was last held in _X_. | The Eiffel Tower is located in _X_. |
| The Wimbledon Men’s Singles winner is from _X_. | The Olympics were last held in _X_. | The Taj Mahal is located in _X_. |
| The UEFA Champions League final will take place in _X_. | The Winter Olympics were last held in _X_. | Burj Khalifa is located in _X_. |
| The G20 summit will be held in _X_. | The FIFA world cup was last won by _X_. | Machu Picchu is located in _X_. |
| The G7 summit will be held in _X_. | The Cricket world cup was last won by _X_. | Stonehenge is located in _X_. |
| The United Nations Climate Change conference will take place in _X_. | _X_ won the most gold medals in the last Olympics. | The world’s largest country by land area is _X_. |
| The world’s longest river is in _X_. | ||
| The world’s tallest mountain is in _X_. | ||