Optimize lora (#2589)

* 支持剪枝前热词增强 * simplify&&fix lora args * fix lora parameters and description * fix lora function args and description * 修复文件 * set lora attention positional arguments * optimize lora codes * add init.py * add lora_ckpt_path to recognize * format codes --------- Co-authored-by: fangcheng1050 <fangcheng1050@wezhuiyi.com>
wenet-e2e · Aug 5, 2024 · ec3d80f · ec3d80f
1 parent 24375c5
commit ec3d80f
Show file tree

Hide file tree

Showing 7 changed files with 88 additions and 367 deletions.
diff --git a/wenet/bin/recognize.py b/wenet/bin/recognize.py
@@ -182,6 +182,10 @@ def get_args():
  type=bool,
  default=False,
  help='''Whether to use lora for biasing''')
+ parser.add_argument("--lora_ckpt_path",
+ default=None,
+ type=str,
+ help="lora checkpoint path.")
  args = parser.parse_args()
  print(args)
  return args

diff --git a/wenet/finetune/lora/__init__.py b/wenet/finetune/lora/__init__.py
diff --git a/wenet/finetune/lora/attention.py b/wenet/finetune/lora/attention.py
diff --git a/wenet/finetune/lora/encoder.py b/wenet/finetune/lora/encoder.py