Skip to content

Add unittest for mix#200

Merged
pan-x-c merged 4 commits intoagentscope-ai:mainfrom
hiyuchang:feat/mix_unittest
Aug 20, 2025
Merged

Add unittest for mix#200
pan-x-c merged 4 commits intoagentscope-ai:mainfrom
hiyuchang:feat/mix_unittest

Conversation

@hiyuchang
Copy link
Collaborator

Description

As the title says.

Checklist

Please check the following items before code is ready to be reviewed.

  • Code has passed all tests
  • Docstrings have been added/updated in Google Style
  • Documentation has been updated
  • Code is ready for review

Copy link
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Summary of Changes

Hello @hiyuchang, I'm Gemini Code Assist1! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed!

This pull request primarily introduces a new unit test for the "MIX" algorithm within the trainer module, ensuring its core functionalities are correctly implemented and verifiable. Additionally, it includes minor adjustments to batch size configurations in two example YAML files, which likely serve to align with updated training parameters or support the new test's operational context.

Highlights

  • New Unit Test for MIX Algorithm: A comprehensive unit test TestTrainerMIX has been added to tests/trainer/trainer_test.py to validate the functionality of the "MIX" algorithm. This test configures various MIX-specific parameters and verifies metrics related to rollout, actor behavior (expert/usual), and response length, ensuring correct operation and checkpointing.
  • Configuration Updates in Examples: The examples/mix_chord/mix_chord.yaml and examples/mix_math/mix_math.yaml files have been updated. Specifically, buffer.batch_size was changed from 40 to 32, and a new buffer.train_batch_size parameter set to 320 was added. A comment for train_batch_size_usual was also updated. These changes likely reflect refined batching strategies or align with the new test's setup.
Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point in your pull request via creating an issue comment (i.e. comment on the pull request page) using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands.

Feature Command Description
Code Review /gemini review Performs a code review for the current pull request in its current state.
Pull Request Summary /gemini summary Provides a summary of the current pull request in its current state.
Comment @gemini-code-assist Responds in comments when explicitly tagged, both in issue comments and review comments.
Help /gemini help Displays a list of available commands.

Customization

To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for Github and other Google products, sign up here.

You can also get AI-powered code generation, chat, as well as code reviews directly in the IDE at no cost with the Gemini Code Assist IDE Extension.

Footnotes

  1. Review the Privacy Notices, Generative AI Prohibited Use Policy, Terms of Service, and learn how to configure Gemini Code Assist in GitHub here. Gemini can make mistakes, so double check it and use code with caution.

Copy link
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request adds a unit test for the MIX algorithm and updates some related example configuration files. The changes in the YAML configuration files are consistent and the new test case in tests/trainer/trainer_test.py properly covers the core functionality of the MIX algorithm. I have one suggestion to improve the structure and readability of the test configuration setup.

@hiyuchang
Copy link
Collaborator Author

/unittest-module-trainer

2 similar comments
@pan-x-c
Copy link
Collaborator

pan-x-c commented Aug 19, 2025

/unittest-module-trainer

@hiyuchang
Copy link
Collaborator Author

/unittest-module-trainer

@hiyuchang
Copy link
Collaborator Author

/unittest-module-trainer

@github-actions
Copy link

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
10 10 0 0 0 0 546ms

Tests

Test Name Status Flaky Duration
tests/trainer/trainer_test.py::BaseTrainerCase::test_trainer 2ms
tests/trainer/trainer_test.py::TestTrainerCountdown::test_trainer 132ms
tests/trainer/trainer_test.py::TestStepAheadAsyncRL::test_trainer 59ms
tests/trainer/trainer_test.py::TestTrainerGSM8K::test_trainer 43ms
tests/trainer/trainer_test.py::TestTrainerSFTWarmupGSM8K::test_trainer 52ms
tests/trainer/trainer_test.py::TestTrainerDPO::test_trainer 32ms
tests/trainer/trainer_test.py::TestTrainerSFT::test_trainer 29ms
tests/trainer/trainer_test.py::TestFullyAsyncMode::test_fully_async_mode_0_queue 58ms
tests/trainer/trainer_test.py::TestFullyAsyncMode::test_fully_async_mode_1_priority_queue 61ms
tests/trainer/trainer_test.py::TestTrainerMIX::test_trainer 70ms

Github Test Reporter by CTRF 💚

@hiyuchang
Copy link
Collaborator Author

/unittest-module-common

@github-actions
Copy link

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
27 27 0 0 0 0 304ms

Tests

Test Name Status Flaky Duration
tests/common/config_test.py::TestConfig::test_all_examples_are_valid 2ms
tests/common/config_test.py::TestConfig::test_config_flatten 1ms
tests/common/config_test.py::TestConfig::test_continue_from_checkpoint_is_valid 1ms
tests/common/config_test.py::TestConfig::test_load_default_config 8ms
tests/common/experience_test.py::TestEID::test_eid_properties 1ms
tests/common/experience_test.py::TestExperience::test_action_mask_and_logprobs_type 1ms
tests/common/experience_test.py::TestExperience::test_assertions 1ms
tests/common/experience_test.py::TestExperience::test_dpo_experience 1ms
tests/common/experience_test.py::TestExperience::test_gather 1ms
tests/common/experience_test.py::TestExperience::test_multi_turn_experience 1ms
tests/common/experience_test.py::TestExperience::test_serialize_deserialize 1ms
tests/common/experience_test.py::TestExperience::test_single_turn_experience 1ms
tests/common/experience_test.py::TestExperience::test_to_dict 1ms
tests/common/experience_test.py::TestExperienceConversion::test_batch_conversion 1ms
tests/common/experience_test.py::TestExperienceConversion::test_dpo_experience_batch_conversion 1ms
tests/common/experience_test.py::TestExperienceConversion::test_experience_model_experience_conversion 1ms
tests/common/experience_test.py::TestExperienceConversion::test_gather_experiences_with_custom_fields 1ms
tests/common/experience_test.py::TestExperienceConversion::test_multiturn_experience_batch_converstion 1ms
tests/common/vllm_test.py::ModelWrapperTest_0::test_generate 36ms
tests/common/vllm_test.py::ModelWrapperTest_1::test_generate 52ms
tests/common/vllm_test.py::ModelWrapperTest_2::test_generate 49ms
tests/common/vllm_test.py::ModelWrapperTest_3::test_generate 36ms
tests/common/vllm_test.py::ModelWrapperTest_4::test_generate 47ms
tests/common/vllm_test.py::TestAPIServer::test_api 23ms
tests/common/vllm_test.py::TestTokenizer::test_assistant_token_mask 1ms
tests/common/vllm_test.py::TestAPIServerToolCall_0_deepseek_r1::test_api_tool_calls 21ms
tests/common/vllm_test.py::TestAPIServerToolCall_1::test_api_tool_calls 20ms

Github Test Reporter by CTRF 💚

@hiyuchang
Copy link
Collaborator Author

/unittest-module-trainer

@github-actions
Copy link

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
10 10 0 0 0 0 525ms

Tests

Test Name Status Flaky Duration
tests/trainer/trainer_test.py::BaseTrainerCase::test_trainer 2ms
tests/trainer/trainer_test.py::TestTrainerCountdown::test_trainer 134ms
tests/trainer/trainer_test.py::TestStepAheadAsyncRL::test_trainer 57ms
tests/trainer/trainer_test.py::TestTrainerGSM8K::test_trainer 43ms
tests/trainer/trainer_test.py::TestTrainerSFTWarmupGSM8K::test_trainer 51ms
tests/trainer/trainer_test.py::TestTrainerDPO::test_trainer 31ms
tests/trainer/trainer_test.py::TestTrainerSFT::test_trainer 29ms
tests/trainer/trainer_test.py::TestFullyAsyncMode::test_fully_async_mode_0_queue 58ms
tests/trainer/trainer_test.py::TestFullyAsyncMode::test_fully_async_mode_1_priority_queue 58ms
tests/trainer/trainer_test.py::TestTrainerMIX::test_trainer 53ms

Github Test Reporter by CTRF 💚

@pan-x-c pan-x-c merged commit 2783593 into agentscope-ai:main Aug 20, 2025
1 check passed
pan-x-c pushed a commit that referenced this pull request Aug 20, 2025
yaochaorui pushed a commit to yaochaorui/Trinity-RFT that referenced this pull request Aug 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants