FIX: readme model performance

RUCAIBox · Jan 3, 2021 · 008daec · 008daec
1 parent 35949ca
commit 008daec
Show file tree

Hide file tree

Showing 2 changed files with 14 additions and 12 deletions.
diff --git a/README.md b/README.md
@@ -210,6 +210,7 @@ We have trained our models on the TG-Redial datasets and recorded relevant evalu
 | TG-ReDial | **0.600** | **0.830** | **0.893** | **0.600** | **0.693** | **0.696** | **0.600** | **0.727** | **0.741** |
 
 
+
 ### Generation Task
 
 | Model | BLEU@1 | BLEU@2 | BLEU@3 | BLEU@4 | Dist@1 | Dist@2 | Dist@3 | Dist@4 | Average | Extreme | Greedy | PPL |
@@ -222,6 +223,7 @@ We have trained our models on the TG-Redial datasets and recorded relevant evalu
 | TG-ReDial | 0.125 | 0.0204 | 0.00354 | 0.000803 | 0.881 | 1.75 | 7.00 | 12.0 | 0.810 | 0.332 | 0.598 | **7.41** |
 
 
+
 ## Releases
 
 | Releases | Date | Features |

diff --git a/README_CN.md b/README_CN.md
@@ -195,38 +195,38 @@ python run_crslab.py --config config/kgsf/redial.yaml --save_data --save_system
 
 ### 推荐任务
 
-| 模型 | Hit@1 | Hit@10 | Hit@50 | MRR@1 | MRR@10 | MRR@50 | NDCG@1 | NDCG@10 | NDCG@50 |
-| :-------: | :---------: | :--------: | :--------: | :--------: | :--------: | :--------: | :---------: | :--------: | :--------: |
-|  KBRD |  0.00401 |  0.0254 | 0.0588 | 0.00401 | 0.00891 |  0.0103 |  0.00401 |  0.0127 |  0.0198 |
-|  KGSF | 0.00535 | **0.0285** | **0.0771** | 0.00535 |  0.0114 | **0.0135** | 0.00535 | **0.0154** | **0.0259** |
-| TG-ReDial | **0.00793** | 0.0251 | 0.0524 | 0.00793 | **0.0122** | 0.0134 | **0.00793** | 0.0152 | 0.0211 |
-| SASRec | 0.000446 | 0.00134 | 0.0160 | 0.000446 | 0.000576 | 0.00114 | 0.000445 | 0.00075 | 0.00380 |
-| TextCNN | 0.00267 |  0.0103 | 0.0236 | 0.00267 | 0.00434 |  0.00493 | 0.00267 |  0.00570 | 0.00860  |
-|  BERT | - | 0.00490 | 0.0281 | **0.0722** |  0.0106 | 0.0124 |  0.00490 | 0.0147 | 0.0239 |
+| 模型 | Hit@1 | Hit@10 | Hit@50 |  MRR@1 | MRR@10 | MRR@50 | NDCG@1 | NDCG@10 | NDCG@50 |
+| :-------: | :---------: | :--------: | :--------: | :---------: | :--------: | :--------: | :---------: | :--------: | :--------: |
+| SASRec | 0.000446 | 0.00134 | 0.0160 | 0.000446 | 0.000576 | 0.00114 | 0.000445 | 0.00075 | 0.00380 |
+| TextCNN | 0.00267 |  0.0103 | 0.0236 |  0.00267 | 0.00434 |  0.00493 | 0.00267 |  0.00570 | 0.00860  |
+|  BERT | 0.00722 | 0.00490 | 0.0281 |  0.00722 |  0.0106 | 0.0124 |  0.00490 | 0.0147 | 0.0239 |
+|  KBRD |  0.00401 |  0.0254 | 0.0588 |  0.00401 | 0.00891 |  0.0103 |  0.00401 |  0.0127 |  0.0198 |
+|  KGSF | 0.00535 | **0.0285** | **0.0771** |  0.00535 |  0.0114 | **0.0135** | 0.00535 | **0.0154** | **0.0259** |
+| TG-ReDial | **0.00793** |  0.0251 | 0.0524 | **0.00793** | **0.0122** | 0.0134 | **0.00793** | 0.0152 | 0.0211 |
 
 
 
 ### 策略任务
 
 | 模型 | Hit@1 | Hit@10 | Hit@50 | MRR@1 | MRR@10 | MRR@50 | NDCG@1 | NDCG@10 | NDCG@50 |
 | :--------: | :-------: | :-------: | :-------: | :-------: | :-------: | :-------: | :-------: | :-------: | :-------: |
-| TG-ReDial | **0.600** | **0.830** | **0.893** | **0.600** | **0.693** | **0.696** | **0.600** | **0.727** | **0.741** |
 | MGCG | 0.591 | 0.818 | 0.883 | 0.591 | 0.680 | 0.683 | 0.591 | 0.712 | 0.729 |
 | Conv-BERT | 0.597 | 0.814 | 0.881 | 0.597 | 0.684 | 0.687 | 0.597 | 0.716 | 0.731 |
 | Topic-BERT | 0.598 | 0.828 | 0.885 | 0.598 | 0.690 | 0.693 | 0.598 | 0.724 | 0.737 |
+| TG-ReDial | **0.600** | **0.830** | **0.893** | **0.600** | **0.693** | **0.696** | **0.600** | **0.727** | **0.741** |
 
 
 
 ### 生成任务
 
 | 模型 | BLEU@1 | BLEU@2 | BLEU@3 | BLEU@4 | Dist@1 | Dist@2 | Dist@3 | Dist@4 | Average | Extreme | Greedy | PPL |
 | :---------: | :-------: | :-------: | :--------: | :--------: | :------: | :------: | :------: | :------: | :-------: | :-------: | :-------: | :------: |
-| KBRD | 0.267 | 0.0458 | 0.0134 | 0.00579 | 0.469 | 1.50 | 3.40 | 4.90 | 0.863 | 0.398 | 0.710 | 52.5 |
-| KGSF | **0.383** | **0.115** | **0.0444** | **0.0200** | 0.340 | 0.910 | 3.50 | 6.20 | **0.888** | **0.477** | **0.767** | 50.1 |
-| TG-ReDial | 0.125 | 0.0204 | 0.00354 | 0.000803 | 0.881 | 1.75 | 7.00 | 12.0 | 0.810 | 0.332 | 0.598 | **7.41** |
 | HERD | 0.120 | 0.0141 | 0.00136 | 0.000350 | 0.181 | 0.369 | 0.847 | 1.30 | 0.697 | 0.382 | 0.639 | 472 |
 | Transformer | 0.266 | 0.0440 | 0.0145 | 0.00651 | 0.324 | 0.837 | 2.02 | 3.06 | 0.879 | 0.438 | 0.680 | 30.9 |
 | GPT2 | 0.0858 | 0.0119 | 0.00377 | 0.0110 | **2.35** | **4.62** | **8.84** | **12.5** | 0.763 | 0.297 | 0.583 | 9.26 |
+| KBRD | 0.267 | 0.0458 | 0.0134 | 0.00579 | 0.469 | 1.50 | 3.40 | 4.90 | 0.863 | 0.398 | 0.710 | 52.5 |
+| KGSF | **0.383** | **0.115** | **0.0444** | **0.0200** | 0.340 | 0.910 | 3.50 | 6.20 | **0.888** | **0.477** | **0.767** | 50.1 |
+| TG-ReDial | 0.125 | 0.0204 | 0.00354 | 0.000803 | 0.881 | 1.75 | 7.00 | 12.0 | 0.810 | 0.332 | 0.598 | **7.41** |