Skip to content

Conversation

@srkreddy1238
Copy link
Contributor

Graph debug runtime to modifications to accommodate profiling through BYOC external calls.
Updated TVMC interface to add more formats while profile dump.
Added CLML helpers that can rebuild cpp CLML sources from profile dumps.
CLML runtime profiling is now controlled by runtime profile flag.

…time)

Graph debug runtime to modifications to acommodate profiling through
BYOC external calls. Updated TVMC interface to add more formats while
profile dump. Added CLML helpers that can rebiuild CPP clml sources
from profile dumps. CLML runtime profiling is now controlled by runtime
profile flag.
@srkreddy1238
Copy link
Contributor Author

@tvm-bot rerun

2 similar comments
@srkreddy1238
Copy link
Contributor Author

@tvm-bot rerun

@srkreddy1238
Copy link
Contributor Author

@tvm-bot rerun

@srkreddy1238
Copy link
Contributor Author

@yongwww & @tqchen can you help to review this PR ?

We do have a pipe line of features to bring in CLML in Relax and CLML offload for LLM's that improves encode significantly.

@tqchen tqchen merged commit 9f2bde5 into apache:main Feb 11, 2025
19 checks passed
@tqchen
Copy link
Member

tqchen commented Feb 11, 2025

Merging, note that some of the relay related features likely needs to be phased out, but the runtime should be resuable for relax, and have good alignment with our latest strategy on target dependent relax pipeline

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants