-
Notifications
You must be signed in to change notification settings - Fork 755
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add benchmark_processing script #261
Conversation
Signed-off-by: lizz <lizz@sensetime.com>
Codecov Report
@@ Coverage Diff @@
## main #261 +/- ##
=======================================
Coverage 85.87% 85.87%
=======================================
Files 132 132
Lines 8802 8802
Branches 1231 1231
=======================================
Hits 7559 7559
Misses 941 941
Partials 302 302
Flags with carried forward coverage won't be shown. Click here to find out more. Continue to review full report at Codecov.
|
rename this tool to upload_data_to_mc? |
Co-authored-by: jeffreykuang <kuangzhanghui@sensetime.com>
Co-authored-by: jeffreykuang <kuangzhanghui@sensetime.com>
Co-authored-by: jeffreykuang <kuangzhanghui@sensetime.com>
Signed-off-by: lizz <lizz@sensetime.com>
I rename the script to benchmark_processing, since it can also be used to find bottleneck in data pipelines. mmpose/mmaction2 also have this script. |
Note in this case, the mc config should be specifed in config, rather than in the cmd line. |
* Flush data script Signed-off-by: lizz <lizz@sensetime.com> * Update tools/run_data.py Co-authored-by: jeffreykuang <kuangzhanghui@sensetime.com> * Update tools/run_data.py Co-authored-by: jeffreykuang <kuangzhanghui@sensetime.com> * Update tools/run_data.py Co-authored-by: jeffreykuang <kuangzhanghui@sensetime.com> * rename to benchmark_processing Signed-off-by: lizz <lizz@sensetime.com> Co-authored-by: jeffreykuang <kuangzhanghui@sensetime.com>
* Flush data script Signed-off-by: lizz <lizz@sensetime.com> * Update tools/run_data.py Co-authored-by: jeffreykuang <kuangzhanghui@sensetime.com> * Update tools/run_data.py Co-authored-by: jeffreykuang <kuangzhanghui@sensetime.com> * Update tools/run_data.py Co-authored-by: jeffreykuang <kuangzhanghui@sensetime.com> * rename to benchmark_processing Signed-off-by: lizz <lizz@sensetime.com> Co-authored-by: jeffreykuang <kuangzhanghui@sensetime.com>
This script go through the training data repeatedly. Useful for data loading benchmark.