Skip to content

Issues: Azure/azure-openai-benchmark

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

21 Open 7 Closed
21 Open 7 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Issue while running benchmarking tool in setting the rpm
#55 opened Aug 5, 2024 by rajm3180
1
Issue with azure benchmarking tool on passing input tokens greater than 30k
#54 opened Jul 29, 2024 by rajm3180
1
Difference in the e2e_avg latency observed in the benchmarking tool and Azure portal
#53 opened Jul 29, 2024 by rajm3180
1
Purpose of stats call condition in while loop?
#42 opened Feb 27, 2024 by sushaanttb
Properly reflecting the count of "requests"
#41 opened Feb 27, 2024 by sushaanttb
Count of Completed Requests & Total Requests is same
#40 opened Feb 27, 2024 by sushaanttb
Documenting about the two types of retry logics for 429 errors.
#38 opened Feb 21, 2024 by sushaanttb
2
Documenting about MAX_RETRY_SECONDS
#37 opened Feb 21, 2024 by sushaanttb
2
Value for MAX_RETRY_SECONDS should not be hardcoded
#36 opened Feb 21, 2024 by sushaanttb
2
Decoupling Throttling retries logic & Throttling backoff logic.
#34 opened Feb 21, 2024 by sushaanttb
4
RETRY_AFTER_MS_HEADER not getting properly "honored"
#33 opened Feb 21, 2024 by sushaanttb
1
Documenting reference for header values used.
#32 opened Feb 21, 2024 by sushaanttb
Considering "retry-after" header as well when retrying throttled requests.
#31 opened Feb 21, 2024 by sushaanttb
1
Renaming "frequence_penalty" function argument to "frequency_penalty"
#30 opened Feb 21, 2024 by sushaanttb
RequestBuilder is prepared with hardcoded value of "gpt-4-0613"
#29 opened Feb 21, 2024 by sushaanttb
Typo when setting "presence penalty" parameter
#28 opened Feb 21, 2024 by sushaanttb
Utilization Statistics - avg, P95
#25 opened Feb 8, 2024 by edjez
Benchmark tool Output to CSV
#24 opened Feb 7, 2024 by edjez
2
Any plan to adding visualization result in this package?
#23 opened Jan 29, 2024 by guming3d
3
Is it possible to do benchmark testing on APIM which has couple of Azure Open AI resources in backend?
#22 opened Jan 23, 2024 by deeepakmhaskar
1
Question about using wonderwords to generate random prompt info enhancement New feature or request
#9 opened Nov 24, 2023 by guming3d
3
ProTip! Adding no:label will show everything without a label.