-
Notifications
You must be signed in to change notification settings - Fork 10
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Where does the score file in FastRerank come from? #2
Comments
You can use the index file to get the templates (summaries of the corresponding training article), and each line contains 30 indices of one sample. The score is the ROUGE-1 of template evaluated with true summary. I'm sorry I didn't include this code, because when I implemented this project, there was no suitable python wrapper for ROUGE evaluation. I had to use the perl version seperatedly for this job. Which was, however, overwritten by other codes. |
Could you give an quick example of what does these 2 json file look like? |
The score.json looks like this, Actually I didn't use the sample.index.json in my code, it is the previous version which I forgot to delete. |
In
config.py
, on line 26-28it seems like the
preprocessing
step needarticle.txt
,title.txt
,template
,samples.index.json
and_score.json
to be prepared inconfig.py
to run the whole processBut after doing retrieve, I only got
train/test/dev.sample.index
other than the original article and title fileSo how can I get all the other data I need such as
sample.index.json
and_score.json
?The text was updated successfully, but these errors were encountered: