-
Notifications
You must be signed in to change notification settings - Fork 3.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Improved MLF to contain workspace info #7938
Conversation
f786fe4
to
aabddcb
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
thanks @manupa-arm , left a few comments and questions from my side
Hi @areusch , Thanks for the review. |
Added functionality to calculate workspace, io and constant memory required by each primfunc and main function. Moreover, the workspace information required by each primfunc and main is reported in metadata.json in the Model Library Format(MLF). - added functionality to record tir and relay primfuncs - added tests for model_library_format changes Change-Id: Ib4a8b787345aa35f8a1645e8a648fad84de37bce
b458a89
to
b8f434f
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
cool, i think this is almost there. let's also bump the version number in Model Library Format, since we are making a change.
* disable AoT for now * addressing comments Change-Id: I5f041ec461b02dac6ea9c96ea50eb400d55eef53
Hi @areusch, I addressed one comment but I still believe there is a value in retaining the constructor in the python for FFI passable object -- but not stressing that we absolutely need it though good to have. Let me know what you think. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
ok great. a few last things, otherwise LGTM. just since there are a number of parallel efforts, want to make sure we document when we'll be changing what for both my and others' sake :)
* addressed comments * added aot executor support Change-Id: I9b54a7939d8ccb3c6ce0454f0fe62866ac66eb5c
* removed redundant utils.py Change-Id: I256dd88fab31a595bf9509bd1c4ab59b0c145b1e
* removed redundant ffi api Change-Id: I9ad6795aa839edfdfd05b902d4531fb0a20e894d
I think I've addessed the comments, PTAL |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
thanks @manupa-arm !
Merge? |
* Improved MLF to contain workspace info Added functionality to calculate workspace, io and constant memory required by each primfunc and main function. Moreover, the workspace information required by each primfunc and main is reported in metadata.json in the Model Library Format(MLF). - added functionality to record tir and relay primfuncs - added tests for model_library_format changes Change-Id: Ib4a8b787345aa35f8a1645e8a648fad84de37bce * Improved MLF to contain workspace info * disable AoT for now * addressing comments Change-Id: I5f041ec461b02dac6ea9c96ea50eb400d55eef53 * Improved MLF to contain workspace info * addressed comments * added aot executor support Change-Id: I9b54a7939d8ccb3c6ce0454f0fe62866ac66eb5c * Improved MLF to contain workspace info * removed redundant utils.py Change-Id: I256dd88fab31a595bf9509bd1c4ab59b0c145b1e * Improved MLF to contain workspace info * removed redundant ffi api Change-Id: I9ad6795aa839edfdfd05b902d4531fb0a20e894d
* Improved MLF to contain workspace info Added functionality to calculate workspace, io and constant memory required by each primfunc and main function. Moreover, the workspace information required by each primfunc and main is reported in metadata.json in the Model Library Format(MLF). - added functionality to record tir and relay primfuncs - added tests for model_library_format changes Change-Id: Ib4a8b787345aa35f8a1645e8a648fad84de37bce * Improved MLF to contain workspace info * disable AoT for now * addressing comments Change-Id: I5f041ec461b02dac6ea9c96ea50eb400d55eef53 * Improved MLF to contain workspace info * addressed comments * added aot executor support Change-Id: I9b54a7939d8ccb3c6ce0454f0fe62866ac66eb5c * Improved MLF to contain workspace info * removed redundant utils.py Change-Id: I256dd88fab31a595bf9509bd1c4ab59b0c145b1e * Improved MLF to contain workspace info * removed redundant ffi api Change-Id: I9ad6795aa839edfdfd05b902d4531fb0a20e894d
* Improved MLF to contain workspace info Added functionality to calculate workspace, io and constant memory required by each primfunc and main function. Moreover, the workspace information required by each primfunc and main is reported in metadata.json in the Model Library Format(MLF). - added functionality to record tir and relay primfuncs - added tests for model_library_format changes Change-Id: Ib4a8b787345aa35f8a1645e8a648fad84de37bce * Improved MLF to contain workspace info * disable AoT for now * addressing comments Change-Id: I5f041ec461b02dac6ea9c96ea50eb400d55eef53 * Improved MLF to contain workspace info * addressed comments * added aot executor support Change-Id: I9b54a7939d8ccb3c6ce0454f0fe62866ac66eb5c * Improved MLF to contain workspace info * removed redundant utils.py Change-Id: I256dd88fab31a595bf9509bd1c4ab59b0c145b1e * Improved MLF to contain workspace info * removed redundant ffi api Change-Id: I9ad6795aa839edfdfd05b902d4531fb0a20e894d
Improving the Model Library Format (MLF) 's metadata.json include workspace size information.
Added functionality to calculate workspace by each primfunc and main function. Additionally, the memory taken by constants and IO is also reported -- in case an executor want to copy them to workspace. Moreover, the workspace information required by each primfunc and main is reported in metadata.json in the Model Library Format(MLF).
cc : @areusch @giuseros @jcf94 @tqchen @Mousius