Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(metric): add detection, precision, and recall diarization metrics #1808

Merged
merged 5 commits into from
Dec 13, 2024

Conversation

hbredin
Copy link
Member

@hbredin hbredin commented Dec 10, 2024

No description provided.

@hbredin hbredin changed the title wip: add new validation metrics feat(metric): add detection, precision, and recall diarization metrics Dec 10, 2024
@hbredin hbredin marked this pull request as ready for review December 10, 2024 20:37
@hbredin hbredin requested a review from FrenchKrab December 11, 2024 12:37
@hbredin
Copy link
Member Author

hbredin commented Dec 11, 2024

cc @FrenchKrab DiarizationPrecision might be useful to compute, as a function of the chunk duration ;)

@hbredin hbredin merged commit 0b7f933 into develop Dec 13, 2024
4 checks passed
@hbredin hbredin deleted the feat/more-validation-metrics branch December 13, 2024 15:42
benniekiss pushed a commit to benniekiss/pyannote-audio that referenced this pull request Feb 3, 2025
config as dict

feat(metric): add detection, precision, and recall diarization metrics (pyannote#1808)

fix: ensure round number of frames

fix: update pipeline parameters in separation tutorial (pyannote#1829)

setup: update torch_audiomentations, pyannote.database, pyannote.metrics and typer dependencies

BREAKING: fix `cache_dir` support, rename `use_auth_token` to `token`, and other changes

feat: add segmentation error rate (pyannote#1836)

doc: improve HF-related docstring

feat: add CLI to apply (and benchmark) pretrained pipelines

binarize annotation optimizations

pass checkpoint as a dict

Squashed commit of the following:

commit 2ccac02
Author: benniekiss <63211101+benniekiss@users.noreply.github.com>
Date:   Wed Jan 29 17:48:15 2025 -0500

    pass checkpoint as a dict

Squashed commit of the following:

commit 0f3b2fe
Author: benniekiss <63211101+benniekiss@users.noreply.github.com>
Date:   Wed Jan 29 17:58:10 2025 -0500

    dont rename tracks when generating annotation

    * let the user decide how to rename tracks, if necessary
    * reduces a costly step for long audios

commit 649c060
Author: benniekiss <63211101+benniekiss@users.noreply.github.com>
Date:   Wed Sep 11 10:31:20 2024 -0400

    conditionally use optimized method

pass checkpoint as a dict

cleanup
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants