Multistage Fusion with Forget Gate for Multimodal Summarization in Open-Domain Videos
You can download the extracted ASR transcription from google drive.
Please go to folder MF_RNN or MF_transformer to start the experiment.
Please use the nmtpytorch evaluation library suggested by the How2 Challenge, which includes BLEU (1, 2, 3, 4), ROUGE-L, METEOR, and CIDEr evaluation metrics.
As an alternative, nlg-eval evaluation library can obtain the same evaluation score as nmtpytorch.
In addition, a ROUGE evaluation library can be used to calculate the ROUGE series (ROUGE-N, ROUGE-L, ROUGE-W) score.
We are very grateful that the code is based on nmtpytorch, fairseq, and machine-translation.