-
Notifications
You must be signed in to change notification settings - Fork 10
Comparing changes
Open a pull request
base repository: log10-io/log10
base: 0.9.1
head repository: log10-io/log10
compare: main
Commits on Jun 13, 2024
-
ENG-851 Update google-generativeai version, example and test (#185)
* Update google-generativeai to 0.6.0 version * Update google example and test with history
Configuration menu - View commit details
-
Copy full SHA for 3f78168 - Browse repository at this point
Copy the full SHA 3f78168View commit details -
Configuration menu - View commit details
-
Copy full SHA for 16544dc - Browse repository at this point
Copy the full SHA 16544dcView commit details -
Configuration menu - View commit details
-
Copy full SHA for 2e30886 - Browse repository at this point
Copy the full SHA 2e30886View commit details
Commits on Jun 17, 2024
-
[ENG-856] Remove large file from repo (#187)
* Remove large file from repo * Styling * Remove large image file and update test --------- Co-authored-by: Kim Tran <ksprtran@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for feb8001 - Browse repository at this point
Copy the full SHA feb8001View commit details -
[ENG-857] Filter large image messages (#190)
* Filter out large images from logs * Filter out single images larger than 1MB * Formatting * Bump image size limit to 4MB * Update magentic test to assert completion id in the platform --------- Co-authored-by: Kim Tran <ksprtran@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for d196918 - Browse repository at this point
Copy the full SHA d196918View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4c19150 - Browse repository at this point
Copy the full SHA 4c19150View commit details
Commits on Jun 21, 2024
-
ENG-849 ENG-819 Refactor Anthropic parsing code for async and sync wi…
…th httpx client (#183) * initial * Support sync message anthropic sdk in httpx hook * Support sync tool_use anthropic in httpx * Support sync completion anthropic call in httpx * Support image sync anthropic call in httpx * Use event hook manager class * More refactor codes * Fix anthropic parsing logics * Update anthropic examples * Update anthropic e2e tests * Update patching openai async httpx client * Fix anthropic legacy completion API call * Encapsulate patching initializer in a class * Add continious tool calls to anthropic test * Address PR feedback * Use pop instead of del * Add AsyncAnthropic client to load.py and update examples * Add example to AsyncAnthropic client and update tests to use log10 anthropic clients * Update magentic tests to support running anthropic * Update magentic version to 0.27.0 * Refactor pytest configs and magentic fixt * Update llm provider to run magentic tests with anthropic model * Format files * Missing func from merge * Address PR feedback * Ignore test image files * Update anthropic version to 0.29.0 * Update test_anthropic to use anthropic model instead of hardcode
Configuration menu - View commit details
-
Copy full SHA for e229ea4 - Browse repository at this point
Copy the full SHA e229ea4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5d1b0bb - Browse repository at this point
Copy the full SHA 5d1b0bbView commit details
Commits on Jun 27, 2024
-
ENG-879 ENG-882 Move cli logic into its own folder (#198)
* Print out missing cli modules * Move cli code into its own folder * Move completions cli to its own file * Add e2e tests for cli commands * Add support cli to display tool_calls * Update poetry.lock file * Rename cli extra group dependencies from 'cliModules' to 'cli' * Add checking pandas, rich, tabulate and simplified if conditions * Separate llm vs cli tests
Configuration menu - View commit details
-
Copy full SHA for cf1ab62 - Browse repository at this point
Copy the full SHA cf1ab62View commit details
Commits on Jul 2, 2024
-
Fix missing logging system message in anthropic (#208)
* Fix missing logging system message in anthropic * Fetch completion in _LogAssertion __init__
Configuration menu - View commit details
-
Copy full SHA for 2df0c73 - Browse repository at this point
Copy the full SHA 2df0c73View commit details -
* Bump version to 0.10.1 * Use different image to differentiate the claude tests * Increase wait time on litellm anthropic image tests
Configuration menu - View commit details
-
Copy full SHA for 617b1e7 - Browse repository at this point
Copy the full SHA 617b1e7View commit details
Commits on Jul 3, 2024
-
Configuration menu - View commit details
-
Copy full SHA for c4f3f56 - Browse repository at this point
Copy the full SHA c4f3f56View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5b129f7 - Browse repository at this point
Copy the full SHA 5b129f7View commit details
Commits on Jul 9, 2024
-
ENG-900 Return early when completion_id is not set (#213)
* Return early when completion_id is not set Combine request functions into one for httpx event hook * Use test_tag_a instead of test_tag_c * Add benchmark test with ids and disable with tags
Configuration menu - View commit details
-
Copy full SHA for 89eafde - Browse repository at this point
Copy the full SHA 89eafdeView commit details
Commits on Jul 10, 2024
-
Support customize httpx timeout config (#216)
* Return early when completion_id is not set Combine request functions into one for httpx event hook * Turn on httpx debug logging and expose read timeout * Add logger error for httpx read timeout exception * Set back to 5s instead * Set httpx read timeout to 10s as default
Configuration menu - View commit details
-
Copy full SHA for 57facfe - Browse repository at this point
Copy the full SHA 57facfeView commit details
Commits on Jul 11, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 89558a4 - Browse repository at this point
Copy the full SHA 89558a4View commit details -
• Updating openai (1.33.0 -> 1.35.13) • Updating anthropic (0.29.0 -> 0.31.0)
Configuration menu - View commit details
-
Copy full SHA for c2ea44e - Browse repository at this point
Copy the full SHA c2ea44eView commit details
Commits on Jul 17, 2024
-
Configuration menu - View commit details
-
Copy full SHA for a92b20d - Browse repository at this point
Copy the full SHA a92b20dView commit details
Commits on Jul 23, 2024
-
Configuration menu - View commit details
-
Copy full SHA for cf71cf6 - Browse repository at this point
Copy the full SHA cf71cf6View commit details -
Configuration menu - View commit details
-
Copy full SHA for c4ccdf3 - Browse repository at this point
Copy the full SHA c4ccdf3View commit details
Commits on Jul 25, 2024
-
Implement feedback filtering in CLI & SDK (#206)
* - Re-implement feedback filtering after re-organization * apply comments and add a test * minor: - test_cli test pass feedback filter value * add a safe_get for getting value from nested dict; minor change on comments --------- Co-authored-by: Wenzhe Xue <wenzhe@log10.io>
Configuration menu - View commit details
-
Copy full SHA for 09e7448 - Browse repository at this point
Copy the full SHA 09e7448View commit details
Commits on Jul 29, 2024
-
add
--save_all_results_to_dataframe
to benchmark_models cli (#233)* add `--save_all_results_to_dataframe` to benchmark_models cli to save all results to a csv file * check usage of --save_all_results_to_dataframe with --file and update doc
Configuration menu - View commit details
-
Copy full SHA for 5713341 - Browse repository at this point
Copy the full SHA 5713341View commit details -
Configuration menu - View commit details
-
Copy full SHA for 00b5817 - Browse repository at this point
Copy the full SHA 00b5817View commit details -
Configuration menu - View commit details
-
Copy full SHA for c49ca5c - Browse repository at this point
Copy the full SHA c49ca5cView commit details
Commits on Jul 30, 2024
-
update benchmark_models cli (#238)
* update benchmark_models cli: * save file with --file only, to md, csv, or jsonl based on file extension * minor
Configuration menu - View commit details
-
Copy full SHA for 7611486 - Browse repository at this point
Copy the full SHA 7611486View commit details
Commits on Jul 31, 2024
-
Fix listing and download completions cli bug (#240)
* Update fetching completions to not get total * Update download completions logic without using total * Update poetry.lock file * Update test_cli assertion to pass with new changes * Fix test assertion * Keep file open while writing data * Remove --compact from cli_docs * Remove unused code * Add warning message for overwriting file and check extensions * Remove .md and .csv extensions * Update spinner with bouncingbar
Configuration menu - View commit details
-
Copy full SHA for 9626930 - Browse repository at this point
Copy the full SHA 9626930View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4f0537a - Browse repository at this point
Copy the full SHA 4f0537aView commit details
Commits on Aug 1, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 920edec - Browse repository at this point
Copy the full SHA 920edecView commit details -
update console message with status update instead of console print (#242
Configuration menu - View commit details
-
Copy full SHA for 4b2e189 - Browse repository at this point
Copy the full SHA 4b2e189View commit details -
Configuration menu - View commit details
-
Copy full SHA for 92cc4c8 - Browse repository at this point
Copy the full SHA 92cc4c8View commit details
Commits on Aug 2, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 2791d60 - Browse repository at this point
Copy the full SHA 2791d60View commit details -
Configuration menu - View commit details
-
Copy full SHA for ed94392 - Browse repository at this point
Copy the full SHA ed94392View commit details
Commits on Aug 8, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 3b2ee60 - Browse repository at this point
Copy the full SHA 3b2ee60View commit details -
Configuration menu - View commit details
-
Copy full SHA for 0002a75 - Browse repository at this point
Copy the full SHA 0002a75View commit details
Commits on Aug 12, 2024
-
update feedback download cli with filter option (#251)
* update feedback download cli with filter option * update feedback download cli options value and type * check file extension to be jsonl
Configuration menu - View commit details
-
Copy full SHA for 57de440 - Browse repository at this point
Copy the full SHA 57de440View commit details
Commits on Aug 13, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 91a8534 - Browse repository at this point
Copy the full SHA 91a8534View commit details -
* Update openai (1.37.1 -> 1.40.6) * update anthropic (0.32.0 -> 0.33.1) * update magentic -> 0.31.0
Configuration menu - View commit details
-
Copy full SHA for 1a9be06 - Browse repository at this point
Copy the full SHA 1a9be06View commit details
Commits on Aug 14, 2024
-
Configuration menu - View commit details
-
Copy full SHA for cbe2b22 - Browse repository at this point
Copy the full SHA cbe2b22View commit details -
add new models to benchmark_models (#265)
* add gpt-4o-2024-08-06 to benchmark_models * add claude-3-5-sonnet-20240620 * fix - missing comma
Configuration menu - View commit details
-
Copy full SHA for 0b945a9 - Browse repository at this point
Copy the full SHA 0b945a9View commit details
Commits on Aug 16, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 439ae3c - Browse repository at this point
Copy the full SHA 439ae3cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 406eb49 - Browse repository at this point
Copy the full SHA 406eb49View commit details
Commits on Aug 19, 2024
-
Configuration menu - View commit details
-
Copy full SHA for b8e6e1f - Browse repository at this point
Copy the full SHA b8e6e1fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 31d7d72 - Browse repository at this point
Copy the full SHA 31d7d72View commit details
Commits on Aug 22, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 86ca72f - Browse repository at this point
Copy the full SHA 86ca72fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 974ce9f - Browse repository at this point
Copy the full SHA 974ce9fView commit details
Commits on Aug 23, 2024
-
Add async streaming support for OpenAI compatible models (#281)
* Add support models via openai sdk * Support perplexity model via openai sdk * Fix quotes around f-string * Update tests to run against openai perplexity compability in openai and magentic * Add openai perplexity compability logging examples * Format files * Add perplexity api key env * Upgrade litellm for magentic * Typo * Rename example logging file * Add comment on openai path list * Update llm_provider -> llm_client for consistency * Feedback
Configuration menu - View commit details
-
Copy full SHA for cfb5272 - Browse repository at this point
Copy the full SHA cfb5272View commit details -
Configuration menu - View commit details
-
Copy full SHA for 59c40e8 - Browse repository at this point
Copy the full SHA 59c40e8View commit details
Commits on Aug 27, 2024
-
cli benchmark_models - support openai fine-tuned models (#287)
* Misc: update mistral models
Configuration menu - View commit details
-
Copy full SHA for ad26c4a - Browse repository at this point
Copy the full SHA ad26c4aView commit details
Commits on Aug 28, 2024
-
Configuration menu - View commit details
-
Copy full SHA for fde3e7d - Browse repository at this point
Copy the full SHA fde3e7dView commit details
Commits on Aug 29, 2024
-
Generalize perplexity logic for streaming end detection across OpenAI…
… compatible models (#286) * Use perplexity logic to check cerabras streaming end indication * Check openai data contains [DONE] first * Check response choices before acessing choices objects * Ensure reaching end stream in the last object * Specific conditions for openai and mistral * Add parameterized for openai compatible tests * Include the newline characters without using a backslash in the f-string * Check for usage to determine reaching the end of cerebras stream * Update using gpt4-o-mini for openai tests * Add cerebras secret to ci test * Remove usage condition
Configuration menu - View commit details
-
Copy full SHA for 98dbb2c - Browse repository at this point
Copy the full SHA 98dbb2cView commit details
There are no files selected for viewing