-
Notifications
You must be signed in to change notification settings - Fork 533
Closed
Milestone
Description
There is lot of torchair code in model runner leading the code hard for maintenance. We'll create new torchair_model_runner to split torchair related logic. There are 5 function contain torchair code. I'll refactor the code in the following step
- create torchair_model_runner [1/N][Refactor] torchair model runner refactor #2205
- move torchair code to common function, so that it can be override by torchair_model_runner
- _get_forward_metadata_across_dp [2/N][Refactor] torchair model runner refactor #2204
- dummy_run [3/N][Refactor] torchair model runner refactor #2207
- _process_reqs [6/N][Refactor] torchair model runner refactor #2220
- initialize_kv_cache [4/N][Refactor] torchair model runner refactor #2208
- capture_model [5/N][Refactor] torchair model runner refactor #2216
- init [7/N][Refactor] torchair model runner refactor #2221
- other common function
MengqingCao and shen-shanshan
Metadata
Metadata
Assignees
Labels
No labels