Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[nodes] KeyframeSelection: Rework the node and add parameters for new selection methods #1880

Merged
merged 11 commits into from
Mar 14, 2023

Conversation

cbentejac
Copy link
Contributor

@cbentejac cbentejac commented Jan 25, 2023

Description

This PR is related to alicevision/AliceVision#1343 and replaces #1765.

It removes the parameters that were previously used for the Keyframe Selection and replaces them with new ones, corresponding to the two newly added selection methods:

  • The regular method, that samples frames regularly over time;
  • The smart method, that scores all the frames based on their sharpness and optical flow, and selects the most relevant.

Features list

  • Remove parameters from the previously existing selection methods
  • Add parameters for the regular selection method
  • Add parameters for the smart selection method
  • Add debugging options related to the smart selection method

This commit removes most of the existing parameters for the keyframe
selection and adds new ones to enable the regular keyframe selection.

Since the regular method is the only one available for now, the parameter
that allows the user to enable it or not is disabled.
Group the keyframe selection parameters together depending on the method
(regular or smart) they belong to.

Parameters for a method are only shown if that method is the currently
selected one.
…ction

If enabled, the scores are computed and, if requested, exported to a CSV
file, but the keyframe selection itself is not performed.
…ectors

Add two debug options to export the computed motion vectors in HSV as PNG
images.
Keyframes will be written as JPG, PNG or EXR files (by default, JPG).
If EXR is the selected output extension, the storage data type can also
be chosen.
Split the existing "rescaledWidth" parameter into "rescaledWidthSharpness"
and "rescaledWidthFlow" to allow independent rescaling of the frames used
to compute the sharpness and motion scores.
@cbentejac cbentejac force-pushed the dev/cleanKeyframeSelection branch from b62e75d to bdf1325 Compare February 6, 2023 16:00
…vely

By default, the keyframes' name is their index within the input sequence /
video. A new option is added to name them as consecutive frames, starting
from 0, instead.
…tions

Add a debug option that will, during the scores' computation, skip all the
calculations regarding sharpness. A fixed sharpness score of 1.0 will be
applied to all the frames.
@fabiencastan fabiencastan added this to the Meshroom 2023.1.0 milestone Mar 13, 2023
@fabiencastan fabiencastan merged commit 9ccece2 into develop Mar 14, 2023
@fabiencastan fabiencastan deleted the dev/cleanKeyframeSelection branch March 14, 2023 16:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants