Validattion code for Overall Performance?

[xmu-xiaoma666]

Thanks for your great job.
I notice that only Unique and Multiple performances are provided in your code. Can you share validation code for Overall Performance?

[yanmin-wu]

Thanks for your interest.
You can double-check it. In fact, the overall performance is already provided. Our final performance is determined using the semantic alignment results from the last layer of the Decoder. As shown below.

[xmu-xiaoma666]

Thanks for your great response. I find the performance for each head is 0. Do you konw why this happens?

[yanmin-wu]

I apologize for forgetting to comment out these two lines. L174 - L175

# note only consider the last layer
if prefix != 'last_':
   continue

I only kept the evaluation output of the last layer. Actually, you only need to refer to the results from this layer.