You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{
"question": "did abraham lincoln write the letter in saving private ryan",
"title": "Bixby letter",
"answer": true,
"passage": "In the 1998 war film Saving Private Ryan, General George Marshall (played by Harve Presnell) reads the Bixby letter to his officers before giving the order
to find and send home Private James Francis Ryan after Ryan's three brothers died in battle."
}
Should the correct answer be false? I can't see how "abraham lincoln" is mentioned in this passage.
The text was updated successfully, but these errors were encountered:
The Bixby Letter is a letter that was in fact written by Abraham Lincoln, though that isn't mentioned in the passage. I'm not sure how a model would know this - I sure didn't.
Seems like a lot of passages contain not enough contextual information to be able to answer these questions without prior knowledge. These tests are only suited for LLM's as my AGI model does not need to read the whole internet to function.
This is an excerpt from
train.json
:Should the correct answer be
false
? I can't see how "abraham lincoln" is mentioned in this passage.The text was updated successfully, but these errors were encountered: