Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

make : use cpuinfo in MSYS2 to enable x86 ISA extensions on the host #1216

Merged
merged 1 commit into from
Aug 28, 2023

Conversation

przemoc
Copy link
Contributor

@przemoc przemoc commented Aug 27, 2023

No description provided.

@przemoc
Copy link
Contributor Author

przemoc commented Aug 27, 2023

Example difference from running:
./main -m models/ggml-tiny.en.bin -f samples/jfk.wav
built on NUC11PHKi7C [Core i7-1165G7 @ 2.80GHz, DDR4-3200 32GB RAM] on MSYS2 UCRT64:

Before:

system_info: n_threads = 4 / 8 | AVX = 0 | AVX2 = 0 | AVX512 = 0 | FMA = 0 | NEON = 0 | ARM_FMA = 0 | F16C = 0 | FP16_VA = 0 | WASM_SIMD = 0 | BLAS = 0 | SSE3 = 1 | SSSE3 = 0 | VSX = 0 | COREML = 0 | OPENVINO = 0 |

main: processing 'samples/jfk.wav' (176000 samples, 11.0 sec), 4 threads, 1 processors, lang = en, task = transcribe, timestamps = 1 ...


[00:00:00.000 --> 00:00:08.000]   And so my fellow Americans ask not what your country can do for you
[00:00:08.000 --> 00:00:11.000]   ask what you can do for your country.

whisper_print_timings:     load time =    25.33 ms
whisper_print_timings:     fallbacks =   0 p /   0 h
whisper_print_timings:      mel time =    18.35 ms
whisper_print_timings:   sample time =    80.90 ms /    27 runs (    3.00 ms per run)
whisper_print_timings:   encode time =  4372.87 ms /     1 runs ( 4372.87 ms per run)
whisper_print_timings:   decode time =   191.05 ms /    27 runs (    7.08 ms per run)
whisper_print_timings:    total time =  4706.81 ms

After:

system_info: n_threads = 4 / 8 | AVX = 1 | AVX2 = 1 | AVX512 = 0 | FMA = 1 | NEON = 0 | ARM_FMA = 0 | F16C = 1 | FP16_VA = 0 | WASM_SIMD = 0 | BLAS = 0 | SSE3 = 1 | SSSE3 = 1 | VSX = 0 | COREML = 0 | OPENVINO = 0 |

main: processing 'samples/jfk.wav' (176000 samples, 11.0 sec), 4 threads, 1 processors, lang = en, task = transcribe, timestamps = 1 ...


[00:00:00.000 --> 00:00:08.000]   And so my fellow Americans ask not what your country can do for you
[00:00:08.000 --> 00:00:11.000]   ask what you can do for your country.

whisper_print_timings:     load time =    27.52 ms
whisper_print_timings:     fallbacks =   0 p /   0 h
whisper_print_timings:      mel time =    23.91 ms
whisper_print_timings:   sample time =    81.49 ms /    27 runs (    3.02 ms per run)
whisper_print_timings:   encode time =   741.10 ms /     1 runs (  741.10 ms per run)
whisper_print_timings:   decode time =    96.98 ms /    27 runs (    3.59 ms per run)
whisper_print_timings:    total time =   993.31 ms

@ggerganov ggerganov merged commit 8e46ba8 into ggerganov:master Aug 28, 2023
35 checks passed
@przemoc przemoc deleted the use-cpuinfo-in-msys2 branch September 1, 2023 07:09
jacobwu-b pushed a commit to jacobwu-b/Transcriptify-by-whisper.cpp that referenced this pull request Oct 24, 2023
jacobwu-b pushed a commit to jacobwu-b/Transcriptify-by-whisper.cpp that referenced this pull request Oct 24, 2023
vonstring pushed a commit to vonstring/whisper.cpp that referenced this pull request Nov 7, 2023
landtanin pushed a commit to landtanin/whisper.cpp that referenced this pull request Dec 16, 2023
iThalay pushed a commit to iThalay/whisper.cpp that referenced this pull request Sep 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants