Massive MP4 conversion speed improvement #349
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Did some profiling with snakeviz today. It was clear where the bulk of our time was spent:
Reading about
ImageQt.fromqimage()
I found out that it would compress to png the whole frame. That operation is completely unnecessary here since PyAV will perform compression to video as well. I found a way to pass an array of bytes instead using numpy. Here are the benchmarks.with
from_image
viaQTImage
:with
from_ndarray
andqimage2ndarray
:This will probably have an impact of our full image size since numpy will be pulled in. However, I think I can get rid of PIL. I'll let CI decide.
I compared the resulting MP4 visually and didn't find a noticeable difference.