-
Notifications
You must be signed in to change notification settings - Fork 3
Home
Kelvin edited this page Jun 19, 2017
·
2 revisions
Welcome to the revs wiki!
- Questions used in the user-based evaluation
ID | source | target | question | answer | wrong_answer1 | wrong_answer2 | wrong_answer3 | hops |
---|---|---|---|---|---|---|---|---|
1 | Ingrid Bergman | Isabella Rossellini | What is the direct relationship between them? | Isabella Rossellini is Ingrid Bergman's child. | Isabella Rossellini is Ingrid Bergman's sister. | Isabella Rossellini is Ingrid Bergman's mother. | No direct relationship. | 1 |
2 | Ingrid Bergman | Isabella Rossellini | What is the film that they co-starred? | A Matter of Time | Elena and Her Men | Journey to Italy | No such film | 2 |
3 | Walt Disney | Roy O. Disney | What is the record label (or record company) that was co-foundered by them? | Walt Disney Records | Disney Reocrds | Walt Disney Music | No such record label | 2 |
4 | Walt Disney | Roy O. Disney | What is the company that was founded by only one of them? | Disneyland Resort | The Walt Disney Company | Walt Disney World | No such company | 2 |
5 | John F. Kennedy | Jacqueline Kennedy Onassis | What is the television show that both of them participated? | A Tour of the White House with Mrs. John F. Kennedy | A Tour of the White House | An interview with Mrs. John F. Kennedy | No such show | 2 |
6 | John F. Kennedy | Jacqueline Kennedy Onassis | Which person served John F. Kennedy as the president and has the same alma mater as Jacqueline's | Mercer Cook | Janet Lee Bouvier | Patrick Bouvier Kennedy | No such person | 3 |
7 | Andrew Jackson | John Quincy Adams | What is the direct relationship between them? | John Quincy Adams was succeeded by Andrew Jackson | John Quincy Adams was preceded by Andrew Jackson | They are relatives | No direct relationship | 1 |
8 | Andrew Jackson | John Quincy Adams | Which office holders served both of them as the president? | Andrew Stevenson | James Barbour | Amos Kendall | Lewis Cass | 2 |
9 | Frank Herbert | Brian Herbert | Which book was co-authored by them? | The Road to Dune | Dreamer of Dune | Dune: House Atreides | The Winds of Dune | 2 |
10 | Frank Herbert | Brian Herbert | What is the book that was authored by Frank Herbert and had Brian Herbert as a non-fiction subject | Dreamer of Dune | The Road to Dune | The Winds of Dune | Dune: House Atreides | 2 |
11 | Abraham Lincoln | George Washington | What is the military unit that participated in a war commanded by Abraham Lincoln and whose notable commander is George Washigton? | Virginia Defense Force | United States Army | Army of Virginia | No such military unit | 3 |
12 | Abraham Lincoln | George Washington | Which office holder served president Lincoln and had the same religion as George Washington's | George M. Dallas | Ulysses S. Grant | John Adams | Thomas Jefferson | 3 |
13 | Christian Bale | Christopher Nolan | Which film was directed by Christopher Nolan and starred by Christian Bale? | The Dark Knight Trilogy | Following | Terminator Salvation | Memento | 2 |
14 | Christian Bale | Christopher Nolan | Which film was starred by Christian Bale and whose writer was Christopher Nolan's relative? | Terminator Salvation | Following | Memento | The Dark Knight Trilogy | 3 |
15 | Hal Roach | Stan Laurel | Which film was produced by Hal Roach and whose writer was Stan Laurel? | Bonnie Scotland | Pardon Us | Way Out West | Our Relations | 2 |
16 | Hal Roach | Stan Laurel | Which film was starred by Stan Laurel and whose writer was Hal Roach? | Wild Poses | They Go Boom | We Faw Down | Their First Mistake | 2 |
17 | Capcom | Sega | Which game was developed by them together? | Mercs | Steep Slope Sliders | Dino Crisis | Gun.Smoke | 2 |
18 | Capcom | Sega | Which is not a game platform that was manufactured by Sega and used by Capcom? | Sega Pico | Dreamcast | Sega Genesis | Sega Saturn | 3 |
19 | IBM | Hewlett-Packard | Which is developed by them together? | Linear Tape File System | OpenVMS | Ultrix | System V | 2 |
20 | IBM | Hewlett-Packard | Which system was developed by Hewlett-Packard and used a programming language developed by IBM? | OpenVMS | HP-UX | Tru64 UNIX | No such system | 3 |
We also provide the JSON file as follows.
[
{
"source": "Ingrid Bergman",
"target": "Isabella Rossellini",
"question": "What is the direct relationship between them?",
"answer": "Isabella Rossellini is Ingrid Bergman's child.",
"wrong_answers": [
"Isabella Rossellini is Ingrid Bergman's sister.",
"Isabella Rossellini is Ingrid Bergman's mother.",
"No direct relationship."
],
"hops": 1
},
{
"source": "Ingrid Bergman",
"target": "Isabella Rossellini",
"question": "What is the film that they co-starred?",
"answer": "A Matter of Time",
"wrong_answers": [
"Elena and Her Men",
"Journey to Italy",
"No such film"
],
"hops": 2
},
{
"source": "Walt Disney",
"target": "Roy O. Disney",
"question": "What is the record label (or record company) that was co-foundered by them?",
"answer": "Walt Disney Records",
"wrong_answers": [
"Disney Reocrds",
"Walt Disney Music",
"No such record label"
],
"hops": 2
},
{
"source": "Walt Disney",
"target": "Roy O. Disney",
"question": "What is the company that was founded by only one of them?",
"answer": "Disneyland Resort",
"wrong_answers": [
"The Walt Disney Company",
"Walt Disney World",
"No such company"
],
"hops": 2
},
{
"source": "John F. Kennedy",
"target": "Jacqueline Kennedy Onassis",
"question": "What is the television show that both of them participated?",
"answer": "A Tour of the White House with Mrs. John F. Kennedy",
"wrong_answers": [
"A Tour of the White House",
"An interview with Mrs. John F. Kennedy",
"No such show"
],
"hops": 2
},
{
"source": "John F. Kennedy",
"target": "Jacqueline Kennedy Onassis",
"question": "Which person served John F. Kennedy as the president and has the same alma mater as Jacqueline's",
"answer": "Mercer Cook",
"wrong_answers": [
"Janet Lee Bouvier",
"Patrick Bouvier Kennedy",
"No such person"
],
"hops": 3
},
{
"source": "Andrew Jackson",
"target": "John Quincy Adams",
"question": "What is the direct relationship between them?",
"answer": "John Quincy Adams was succeeded by Andrew Jackson",
"wrong_answers": [
"John Quincy Adams was preceded by Andrew Jackson",
"They are relatives",
"No direct relationship"
],
"hops": 1
},
{
"source": "Andrew Jackson",
"target": "John Quincy Adams",
"question": "Which office holders served both of them as the president? ",
"answer": "Andrew Stevenson",
"wrong_answers": [
"James Barbour",
"Amos Kendall",
"Lewis Cass"
],
"hops": 2
},
{
"source": "Frank Herbert",
"target": "Brian Herbert",
"question": "Which book was co-authored by them?",
"answer": "The Road to Dune",
"wrong_answers": [
"Dreamer of Dune",
"Dune: House Atreides",
"The Winds of Dune"
],
"hops": 2
},
{
"source": "Frank Herbert",
"target": "Brian Herbert",
"question": "What is the book that was authored by Frank Herbert and had Brian Herbert as a non-fiction subject",
"answer": "Dreamer of Dune",
"wrong_answers": [
"The Road to Dune",
"The Winds of Dune",
"Dune: House Atreides"
],
"hops": 2
},
{
"source": "Abraham Lincoln",
"target": "George Washington",
"question": "What is the military unit that participated in a war commanded by Abraham Lincoln and whose notable commander is George Washigton?",
"answer": "Virginia Defense Force",
"wrong_answers": [
"United States Army",
"Army of Virginia",
"No such military unit"
],
"hops": 3
},
{
"source": "Abraham Lincoln",
"target": "George Washington",
"question": "Which office holder served president Lincoln and had the same religion as George Washington's",
"answer": "George M. Dallas",
"wrong_answers": [
"Ulysses S. Grant",
"John Adams",
"Thomas Jefferson"
],
"hops": 3
},
{
"source": "Christian Bale",
"target": "Christopher Nolan",
"question": "Which film was directed by Christopher Nolan and starred by Christian Bale?",
"answer": "The Dark Knight Trilogy",
"wrong_answers": [
"Following",
"Terminator Salvation",
"Memento"
],
"hops": 2
},
{
"source": "Christian Bale",
"target": "Christopher Nolan",
"question": "Which film was starred by Christian Bale and whose writer was Christopher Nolan's relative?",
"answer": "Terminator Salvation",
"wrong_answers": [
"Following",
"Memento",
"The Dark Knight Trilogy"
],
"hops": 3
},
{
"source": "Hal Roach",
"target": "Stan Laurel",
"question": "Which film was produced by Hal Roach and whose writer was Stan Laurel?",
"answer": "Bonnie Scotland",
"wrong_answers": [
"Pardon Us",
"Way Out West",
"Our Relations"
],
"hops": 2
},
{
"source": "Hal Roach",
"target": "Stan Laurel",
"question": "Which film was starred by Stan Laurel and whose writer was Hal Roach?",
"answer": "Wild Poses",
"wrong_answers": [
"They Go Boom",
"We Faw Down",
"Their First Mistake"
],
"hops": 2
},
{
"source": "Capcom",
"target": "Sega",
"question": "Which game was developed by them together?",
"answer": "Mercs",
"wrong_answers": [
"Steep Slope Sliders",
"Dino Crisis",
"Gun.Smoke"
],
"hops": 2
},
{
"source": "Capcom",
"target": "Sega",
"question": "Which is not a game platform that was manufactured by Sega and used by Capcom?",
"answer": "Sega Pico",
"wrong_answers": [
"Dreamcast",
"Sega Genesis",
"Sega Saturn"
],
"hops": 3
},
{
"source": "IBM",
"target": "Hewlett-Packard",
"question": "Which is developed by them together?",
"answer": "Linear Tape File System",
"wrong_answers": [
"OpenVMS",
"Ultrix",
"System V"
],
"hops": 2
},
{
"source": "IBM",
"target": "Hewlett-Packard",
"question": "Which system was developed by Hewlett-Packard and used a programming language developed by IBM?",
"answer": "OpenVMS",
"wrong_answers": [
"HP-UX",
"Tru64 UNIX",
"No such system"
],
"hops": 3
}
]