Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

what is the file of 'resFileList' in the file computeDivStats.py? #5

Open
KentHwang1 opened this issue May 25, 2021 · 1 comment
Open

Comments

@KentHwang1
Copy link

can anyone tell what is the file of 'resfile' in the file computeDivStats?
image
Thank you so much!

@sabirdvd
Copy link

sabirdvd commented Nov 7, 2021

@KentHwang1 python computeDivStats.py result_struct_minitest_baselineResNet-beamsearch-b5.json
Try to print the json file (downloaded file)

if you print the json file,

python3 -m json.tool result_struct_minitest_baselineResNet-beamsearch-b5.json

you will see that this file follows that format.

python computeDivStats.py result_struct_minitest_baselineResNet-beamsearch-b5.json

output

PTBTokenizer tokenized 272540 tokens at 419425.53 tokens per second.
Diversity Statistics are as follows: 
 Div1: 0.28, Div2: 0.38, gDiv1: 1085

{'reflen': 46801, 'guess': [46020, 41020, 36020, 31020], 'testlen': 46020, 'correct': [43020, 35358, 28405, 22222]}
ratio: 0.983312322386
{'reflen': 46975, 'guess': [46916, 41916, 36916, 31916], 'testlen': 46916, 'correct': [43339, 35247, 28102, 21783]}
ratio: 0.998744012773
{'reflen': 48074, 'guess': [48461, 43461, 38461, 33461], 'testlen': 48461, 'correct': [44245, 35939, 28625, 22284]}
ratio: 1.00805008945
{'reflen': 50076, 'guess': [50895, 45895, 40895, 35895], 'testlen': 50895, 'correct': [46321, 38103, 30813, 24459]}
ratio: 1.01635514019
{'reflen': 51401, 'guess': [55249, 50249, 45249, 40249], 'testlen': 55249, 'correct': [47690, 39384, 32153, 25879]}
ratio: 1.07486235676
Mean mutual Bleu scores on this set is:
mBLeu_1, mBLeu_2, mBLeu_3, mBLeu_4

[0.90559812 0.86469403 0.82418264 0.78411753]

For more detail please refer to this repository. https://github.com/sabirdvd/DivStats_Caption

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants