[FEATURE] Recommend in docs using `py_executable: "uv run"`

[vadimkantorov]

To submit the Ray job to the cluster (it will install all environment in a repeatable/cacheable way)

Another nice thing is to pin flash_attn to direct whl link from GitHub releases (might be done with uv run --with=https://github.com/Dao-AILab/flash-attention/releases/download/v2.8.3/flash_attn-2.8.3+cu12torch2.8cxx11abiTRUE-cp312-cp312-linux_x86_64.whl or similar for 2.8.1), this will avoid lengthy building from sources

[nkkarpov]

It is useless recommendation. Obviously, Trinity-RFT doesn't use uv as a toolchain for building etc. Moreover, the current version of Trinity-RFT has dependencies issues that requires manual resolutions. See #157

[vadimkantorov]

Indeed, currently trinity does not use uv. But uv is getting more popular fast and "py_executable": "uv run" provides a simple way to set up dependencies when submitting a ray job (maybe the same might be achieved with a custom wrapper using vanilla pip, but would require more work). So I respectfully disagree it would be a useless recommendation.

Regarding manual resolution of dependencies, I managed to encode some of them using uv overrides feature in pyproject.toml, so I assume it can also be done for juicer etc

[vadimkantorov]

@hiyuchang This hacky workaround for me:

git clone https://github.com/modelscope/Trinity-RFT
cd Trinity-RFT
printf '[tool.uv]\noverride-dependencies=["spacy>=3.8.2"]' >> pyproject.toml
uv sync --python=3.12

The real fix would be to have rm-gallery and data-juicer folks push out new PyPi service releases and depend on the new versions:

• [fix] fix dependencies OpenJudge#12 (comment)
• build: update spacy dependency version datajuicer/data-juicer#763 (comment)
  and also update pyproject.toml to recent dependencies of data-juicer and rm-gallery. Currently this also works:

[project.optional-dependencies]
data = [
    "py-data-juicer @ git+https://github.com/modelscope/data-juicer@main#5b3149a32d09047224c59fda2bace0ce8423304b"
]
agent = [
    "agentscope"
]
rm_gallery = [
    "rm-gallery @ git+https://github.com/modelscope/RM-Gallery@main#b5632b7b5d039110e3397b6cf4b6dba1c929c663"
]

---

Without any of these fixes one gets a very nasty error:

Using CPython 3.12.11 interpreter at: /usr/bin/python3.12
Creating virtual environment at: .venv
  × No solution found when resolving dependencies for split (markers: python_full_version >= '4' and platform_machine == 'aarch64' and
  │ sys_platform == 'linux'):
  ╰─▶ Because only the following versions of fastapi-cli[standard] are available:
          fastapi-cli[standard]<=0.0.8
          fastapi-cli[standard]==0.0.9
          fastapi-cli[standard]==0.0.10
      and fastapi-cli>=0.0.8 depends on typer>=0.15.1, we can conclude that fastapi-cli[standard]>=0.0.8,<0.0.9 depends on typer>=0.15.1.
      And because fastapi-cli>=0.0.9 depends on typer>=0.15.1, we can conclude that fastapi-cli[standard]>=0.0.8,<0.0.10 depends on
      typer>=0.15.1.
      And because fastapi-cli==0.0.10 depends on typer>=0.15.1 and fastapi[standard]==0.116.1 depends on fastapi-cli[standard]>=0.0.8, we can
      conclude that fastapi[standard]==0.116.1 depends on typer>=0.15.1. (1)

      Because fastapi-cli==0.0.10 depends on typer>=0.15.1 and typer>=0.15.1, we can conclude that fastapi-cli[standard]>=0.0.9 depends on
      typer>=0.15.1.
      And because fastapi-cli>=0.0.8 depends on typer>=0.15.1, we can conclude that fastapi-cli[standard]>=0.0.8 depends on typer>=0.15.1.
      And because only the following versions of fastapi-cli[standard] are available:
          fastapi-cli[standard]<=0.0.8
          fastapi-cli[standard]==0.0.9
          fastapi-cli[standard]==0.0.10
      and fastapi[standard]>=0.116.0 depends on fastapi-cli[standard]>=0.0.8, we can conclude that fastapi[standard]>=0.116.0 depends on
      typer>=0.15.1.
      And because we know from (1) that fastapi[standard]==0.116.1 depends on typer>=0.15.1, we can conclude that fastapi[standard]>=0.116.0
      depends on typer>=0.15.1. (2)

      Because only the following versions of fastapi-cli[standard] are available:
          fastapi-cli[standard]<=0.0.5
          fastapi-cli[standard]==0.0.6
          fastapi-cli[standard]==0.0.7
          fastapi-cli[standard]>=0.0.8
      and fastapi-cli>=0.0.5,<=0.0.7 depends on typer>=0.12.3, we can conclude that fastapi-cli[standard]>=0.0.5,<0.0.6 depends on
      typer>=0.12.3.
      And because fastapi-cli>=0.0.6,<=0.0.7 depends on typer>=0.12.3, we can conclude that fastapi-cli[standard]>=0.0.5,<0.0.7 depends on
      typer>=0.12.3.
      And because fastapi-cli==0.0.7 depends on typer>=0.12.3 and typer>=0.15.1, we can conclude that all of:
          fastapi-cli[standard]>=0.0.5,<0.0.8
          fastapi-cli[standard]>=0.0.10
      depend on typer>=0.12.3.
      And because fastapi-cli>=0.0.9 depends on typer>=0.15.1 and typer>=0.15.1, we can conclude that fastapi-cli[standard]>=0.0.5 depends
      on typer>=0.12.3.
      And because only the following versions of fastapi-cli[standard] are available:
          fastapi-cli[standard]<=0.0.8
          fastapi-cli[standard]==0.0.9
          fastapi-cli[standard]==0.0.10
      and fastapi[standard]==0.115.14 depends on fastapi-cli[standard]>=0.0.5, we can conclude that fastapi[standard]==0.115.14 depends on
      typer>=0.12.3.
      And because we know from (2) that fastapi[standard]>=0.116.0 depends on typer>=0.15.1, we can conclude that fastapi[standard]>=0.115.14
      depends on typer>=0.12.3. (3)

      Because fastapi-cli==0.0.10 depends on typer>=0.15.1 and typer>=0.15.1, we can conclude that fastapi-cli[standard]>=0.0.9 depends on
      typer>=0.15.1.
      And because fastapi-cli>=0.0.8 depends on typer>=0.15.1, we can conclude that fastapi-cli[standard]>=0.0.8 depends on typer>=0.15.1.
      And because only the following versions of fastapi-cli[standard] are available:
          fastapi-cli[standard]<=0.0.8
          fastapi-cli[standard]==0.0.9
          fastapi-cli[standard]==0.0.10
      and fastapi-cli==0.0.7 depends on typer>=0.12.3, we can conclude that fastapi-cli[standard]>=0.0.7 depends on typer>=0.12.3.
      And because fastapi-cli>=0.0.6,<=0.0.7 depends on typer>=0.12.3 and typer>=0.12.3, we can conclude that fastapi-cli[standard]>=0.0.5
      depends on typer>=0.12.3.
      And because only the following versions of fastapi-cli[standard] are available:
          fastapi-cli[standard]<=0.0.5
          fastapi-cli[standard]==0.0.6
          fastapi-cli[standard]==0.0.7
          fastapi-cli[standard]>=0.0.8
      and fastapi[standard]>=0.115.13,<=0.115.14 depends on fastapi-cli[standard]>=0.0.5, we can conclude that
      fastapi[standard]>=0.115.13,<=0.115.14 depends on typer>=0.12.3.
      And because we know from (3) that fastapi[standard]>=0.115.14 depends on typer>=0.12.3, we can conclude that fastapi[standard]>=0.115.13
      depends on typer>=0.12.3. (4)

      Because fastapi-cli==0.0.10 depends on typer>=0.15.1 and typer>=0.15.1, we can conclude that fastapi-cli[standard]>=0.0.9 depends on
      typer>=0.15.1.
      And because fastapi-cli>=0.0.8 depends on typer>=0.15.1, we can conclude that fastapi-cli[standard]>=0.0.8 depends on typer>=0.15.1.
      And because only the following versions of fastapi-cli[standard] are available:
          fastapi-cli[standard]<=0.0.8
          fastapi-cli[standard]==0.0.9
          fastapi-cli[standard]==0.0.10
      and fastapi-cli==0.0.7 depends on typer>=0.12.3, we can conclude that fastapi-cli[standard]>=0.0.7 depends on typer>=0.12.3.
      And because fastapi-cli>=0.0.6,<=0.0.7 depends on typer>=0.12.3 and typer>=0.12.3, we can conclude that fastapi-cli[standard]>=0.0.5
      depends on typer>=0.12.3.
      And because only the following versions of fastapi-cli[standard] are available:
          fastapi-cli[standard]<=0.0.5
          fastapi-cli[standard]==0.0.6
          fastapi-cli[standard]==0.0.7
          fastapi-cli[standard]>=0.0.8
      and fastapi[standard]>=0.115.12,<=0.115.14 depends on fastapi-cli[standard]>=0.0.5, we can conclude that
      fastapi[standard]>=0.115.12,<=0.115.14 depends on typer>=0.12.3.
      And because we know from (4) that fastapi[standard]>=0.115.13 depends on typer>=0.12.3, we can conclude that fastapi[standard]>=0.115.12
      depends on typer>=0.12.3. (5)

      Because fastapi-cli==0.0.10 depends on typer>=0.15.1 and typer>=0.15.1, we can conclude that fastapi-cli[standard]>=0.0.9 depends on
      typer>=0.15.1.
      And because fastapi-cli>=0.0.8 depends on typer>=0.15.1, we can conclude that fastapi-cli[standard]>=0.0.8 depends on typer>=0.15.1.
      And because only the following versions of fastapi-cli[standard] are available:
          fastapi-cli[standard]<=0.0.8
          fastapi-cli[standard]==0.0.9
          fastapi-cli[standard]==0.0.10
      and fastapi-cli==0.0.7 depends on typer>=0.12.3, we can conclude that fastapi-cli[standard]>=0.0.7 depends on typer>=0.12.3.
      And because fastapi-cli>=0.0.6,<=0.0.7 depends on typer>=0.12.3 and typer>=0.12.3, we can conclude that fastapi-cli[standard]>=0.0.5
      depends on typer>=0.12.3.
      And because only the following versions of fastapi-cli[standard] are available:
          fastapi-cli[standard]<=0.0.5
          fastapi-cli[standard]==0.0.6
          fastapi-cli[standard]==0.0.7
          fastapi-cli[standard]>=0.0.8
      and fastapi[standard]>=0.115.11,<=0.115.14 depends on fastapi-cli[standard]>=0.0.5, we can conclude that
      fastapi[standard]>=0.115.11,<=0.115.14 depends on typer>=0.12.3.
      And because we know from (5) that fastapi[standard]>=0.115.12 depends on typer>=0.12.3, we can conclude that fastapi[standard]>=0.115.11
      depends on typer>=0.12.3. (6)

      Because fastapi-cli==0.0.10 depends on typer>=0.15.1 and typer>=0.15.1, we can conclude that fastapi-cli[standard]>=0.0.9 depends on
      typer>=0.15.1.
      And because fastapi-cli>=0.0.8 depends on typer>=0.15.1, we can conclude that fastapi-cli[standard]>=0.0.8 depends on typer>=0.15.1.
      And because only the following versions of fastapi-cli[standard] are available:
          fastapi-cli[standard]<=0.0.8
          fastapi-cli[standard]==0.0.9
          fastapi-cli[standard]==0.0.10
      and fastapi-cli==0.0.7 depends on typer>=0.12.3, we can conclude that fastapi-cli[standard]>=0.0.7 depends on typer>=0.12.3.
      And because fastapi-cli>=0.0.6,<=0.0.7 depends on typer>=0.12.3 and typer>=0.12.3, we can conclude that fastapi-cli[standard]>=0.0.5
      depends on typer>=0.12.3.
      And because only the following versions of fastapi-cli[standard] are available:
          fastapi-cli[standard]<=0.0.5
          fastapi-cli[standard]==0.0.6
          fastapi-cli[standard]==0.0.7
          fastapi-cli[standard]>=0.0.8
      and fastapi[standard]>=0.115.10,<=0.115.14 depends on fastapi-cli[standard]>=0.0.5, we can conclude that
      fastapi[standard]>=0.115.10,<=0.115.14 depends on typer>=0.12.3.
      And because we know from (6) that fastapi[standard]>=0.115.11 depends on typer>=0.12.3, we can conclude that fastapi[standard]>=0.115.10
      depends on typer>=0.12.3. (7)

      Because fastapi-cli==0.0.10 depends on typer>=0.15.1 and typer>=0.15.1, we can conclude that fastapi-cli[standard]>=0.0.9 depends on
      typer>=0.15.1.
      And because fastapi-cli>=0.0.8 depends on typer>=0.15.1, we can conclude that fastapi-cli[standard]>=0.0.8 depends on typer>=0.15.1.
      And because only the following versions of fastapi-cli[standard] are available:
          fastapi-cli[standard]<=0.0.8
          fastapi-cli[standard]==0.0.9
          fastapi-cli[standard]==0.0.10
      and fastapi-cli==0.0.7 depends on typer>=0.12.3, we can conclude that fastapi-cli[standard]>=0.0.7 depends on typer>=0.12.3.
      And because fastapi-cli>=0.0.6,<=0.0.7 depends on typer>=0.12.3 and typer>=0.12.3, we can conclude that fastapi-cli[standard]>=0.0.5
      depends on typer>=0.12.3.
      And because only the following versions of fastapi-cli[standard] are available:
          fastapi-cli[standard]<=0.0.5
          fastapi-cli[standard]==0.0.6
          fastapi-cli[standard]==0.0.7
          fastapi-cli[standard]>=0.0.8
      and fastapi[standard]>=0.115.9,<=0.115.14 depends on fastapi-cli[standard]>=0.0.5, we can conclude that
      fastapi[standard]>=0.115.9,<=0.115.14 depends on typer>=0.12.3.
      And because we know from (7) that fastapi[standard]>=0.115.10 depends on typer>=0.12.3, we can conclude that fastapi[standard]>=0.115.9
      depends on typer>=0.12.3. (8)

      Because fastapi-cli==0.0.10 depends on typer>=0.15.1 and typer>=0.15.1, we can conclude that fastapi-cli[standard]>=0.0.9 depends on
      typer>=0.15.1.
      And because fastapi-cli>=0.0.8 depends on typer>=0.15.1, we can conclude that fastapi-cli[standard]>=0.0.8 depends on typer>=0.15.1.
      And because only the following versions of fastapi-cli[standard] are available:
          fastapi-cli[standard]<=0.0.8
          fastapi-cli[standard]==0.0.9
          fastapi-cli[standard]==0.0.10
      and fastapi-cli==0.0.7 depends on typer>=0.12.3, we can conclude that fastapi-cli[standard]>=0.0.7 depends on typer>=0.12.3.
      And because fastapi-cli>=0.0.6,<=0.0.7 depends on typer>=0.12.3 and typer>=0.12.3, we can conclude that fastapi-cli[standard]>=0.0.5
      depends on typer>=0.12.3.
      And because only the following versions of fastapi-cli[standard] are available:
          fastapi-cli[standard]<=0.0.5
          fastapi-cli[standard]==0.0.6
          fastapi-cli[standard]==0.0.7
          fastapi-cli[standard]>=0.0.8
      and fastapi[standard]>=0.115.8,<=0.115.14 depends on fastapi-cli[standard]>=0.0.5, we can conclude that
      fastapi[standard]>=0.115.8,<=0.115.14 depends on typer>=0.12.3.
      And because we know from (8) that fastapi[standard]>=0.115.9 depends on typer>=0.12.3, we can conclude that fastapi[standard]>=0.115.8
      depends on typer>=0.12.3. (9)

      Because fastapi-cli==0.0.10 depends on typer>=0.15.1 and typer>=0.15.1, we can conclude that fastapi-cli[standard]>=0.0.9 depends on
      typer>=0.15.1.
      And because fastapi-cli>=0.0.8 depends on typer>=0.15.1, we can conclude that fastapi-cli[standard]>=0.0.8 depends on typer>=0.15.1.
      And because only the following versions of fastapi-cli[standard] are available:
          fastapi-cli[standard]<=0.0.8
          fastapi-cli[standard]==0.0.9
          fastapi-cli[standard]==0.0.10
      and fastapi-cli==0.0.7 depends on typer>=0.12.3, we can conclude that fastapi-cli[standard]>=0.0.7 depends on typer>=0.12.3.
      And because fastapi-cli>=0.0.6,<=0.0.7 depends on typer>=0.12.3 and typer>=0.12.3, we can conclude that fastapi-cli[standard]>=0.0.5
      depends on typer>=0.12.3.
      And because only the following versions of fastapi-cli[standard] are available:
          fastapi-cli[standard]<=0.0.5
          fastapi-cli[standard]==0.0.6
          fastapi-cli[standard]==0.0.7
          fastapi-cli[standard]>=0.0.8
      and fastapi[standard]>=0.115.7,<=0.115.14 depends on fastapi-cli[standard]>=0.0.5, we can conclude that
      fastapi[standard]>=0.115.7,<=0.115.14 depends on typer>=0.12.3.
      And because we know from (9) that fastapi[standard]>=0.115.8 depends on typer>=0.12.3, we can conclude that fastapi[standard]>=0.115.7
      depends on typer>=0.12.3. (10)

      Because fastapi-cli==0.0.10 depends on typer>=0.15.1 and typer>=0.15.1, we can conclude that fastapi-cli[standard]>=0.0.9 depends on
      typer>=0.15.1.
      And because fastapi-cli>=0.0.8 depends on typer>=0.15.1, we can conclude that fastapi-cli[standard]>=0.0.8 depends on typer>=0.15.1.
      And because only the following versions of fastapi-cli[standard] are available:
          fastapi-cli[standard]<=0.0.8
          fastapi-cli[standard]==0.0.9
          fastapi-cli[standard]==0.0.10
      and fastapi-cli==0.0.7 depends on typer>=0.12.3, we can conclude that fastapi-cli[standard]>=0.0.7 depends on typer>=0.12.3.
      And because fastapi-cli>=0.0.6,<=0.0.7 depends on typer>=0.12.3 and typer>=0.12.3, we can conclude that fastapi-cli[standard]>=0.0.5
      depends on typer>=0.12.3.
      And because only the following versions of fastapi-cli[standard] are available:
          fastapi-cli[standard]<=0.0.5
          fastapi-cli[standard]==0.0.6
          fastapi-cli[standard]==0.0.7
          fastapi-cli[standard]>=0.0.8
      and fastapi[standard]>=0.115.6,<=0.115.14 depends on fastapi-cli[standard]>=0.0.5, we can conclude that
      fastapi[standard]>=0.115.6,<=0.115.14 depends on typer>=0.12.3.
      And because we know from (10) that fastapi[standard]>=0.115.7 depends on typer>=0.12.3, we can conclude that fastapi[standard]>=0.115.6
      depends on typer>=0.12.3. (11)

      Because fastapi-cli==0.0.10 depends on typer>=0.15.1 and typer>=0.15.1, we can conclude that fastapi-cli[standard]>=0.0.9 depends on
      typer>=0.15.1.
      And because fastapi-cli>=0.0.8 depends on typer>=0.15.1, we can conclude that fastapi-cli[standard]>=0.0.8 depends on typer>=0.15.1.
      And because only the following versions of fastapi-cli[standard] are available:
          fastapi-cli[standard]<=0.0.8
          fastapi-cli[standard]==0.0.9
          fastapi-cli[standard]==0.0.10
      and fastapi-cli==0.0.7 depends on typer>=0.12.3, we can conclude that fastapi-cli[standard]>=0.0.7 depends on typer>=0.12.3.
      And because fastapi-cli>=0.0.6,<=0.0.7 depends on typer>=0.12.3 and typer>=0.12.3, we can conclude that fastapi-cli[standard]>=0.0.5
      depends on typer>=0.12.3.
      And because only the following versions of fastapi-cli[standard] are available:
          fastapi-cli[standard]<=0.0.5
          fastapi-cli[standard]==0.0.6
          fastapi-cli[standard]==0.0.7
          fastapi-cli[standard]>=0.0.8
      and fastapi[standard]>=0.115.5,<=0.115.14 depends on fastapi-cli[standard]>=0.0.5, we can conclude that
      fastapi[standard]>=0.115.5,<=0.115.14 depends on typer>=0.12.3.
      And because we know from (11) that fastapi[standard]>=0.115.6 depends on typer>=0.12.3, we can conclude that fastapi[standard]>=0.115.5
      depends on typer>=0.12.3. (12)

      Because fastapi-cli==0.0.10 depends on typer>=0.15.1 and typer>=0.15.1, we can conclude that fastapi-cli[standard]>=0.0.9 depends on
      typer>=0.15.1.
      And because fastapi-cli>=0.0.8 depends on typer>=0.15.1, we can conclude that fastapi-cli[standard]>=0.0.8 depends on typer>=0.15.1.
      And because only the following versions of fastapi-cli[standard] are available:
          fastapi-cli[standard]<=0.0.8
          fastapi-cli[standard]==0.0.9
          fastapi-cli[standard]==0.0.10
      and fastapi-cli==0.0.7 depends on typer>=0.12.3, we can conclude that fastapi-cli[standard]>=0.0.7 depends on typer>=0.12.3.
      And because fastapi-cli>=0.0.6,<=0.0.7 depends on typer>=0.12.3 and typer>=0.12.3, we can conclude that fastapi-cli[standard]>=0.0.5
      depends on typer>=0.12.3.
      And because only the following versions of fastapi-cli[standard] are available:
          fastapi-cli[standard]<=0.0.5
          fastapi-cli[standard]==0.0.6
          fastapi-cli[standard]==0.0.7
          fastapi-cli[standard]>=0.0.8
      and fastapi[standard]>=0.115.4,<=0.115.14 depends on fastapi-cli[standard]>=0.0.5, we can conclude that
      fastapi[standard]>=0.115.4,<=0.115.14 depends on typer>=0.12.3.
      And because we know from (12) that fastapi[standard]>=0.115.5 depends on typer>=0.12.3, we can conclude that fastapi[standard]>=0.115.4
      depends on typer>=0.12.3. (13)

      Because fastapi-cli==0.0.10 depends on typer>=0.15.1 and typer>=0.15.1, we can conclude that fastapi-cli[standard]>=0.0.9 depends on
      typer>=0.15.1.
      And because fastapi-cli>=0.0.8 depends on typer>=0.15.1, we can conclude that fastapi-cli[standard]>=0.0.8 depends on typer>=0.15.1.
      And because only the following versions of fastapi-cli[standard] are available:
          fastapi-cli[standard]<=0.0.8
          fastapi-cli[standard]==0.0.9
          fastapi-cli[standard]==0.0.10
      and fastapi-cli==0.0.7 depends on typer>=0.12.3, we can conclude that fastapi-cli[standard]>=0.0.7 depends on typer>=0.12.3.
      And because fastapi-cli>=0.0.6,<=0.0.7 depends on typer>=0.12.3 and typer>=0.12.3, we can conclude that fastapi-cli[standard]>=0.0.5
      depends on typer>=0.12.3.
      And because only the following versions of fastapi-cli[standard] are available:
          fastapi-cli[standard]<=0.0.5
          fastapi-cli[standard]==0.0.6
          fastapi-cli[standard]==0.0.7
          fastapi-cli[standard]>=0.0.8
      and fastapi[standard]>=0.115.3,<=0.115.14 depends on fastapi-cli[standard]>=0.0.5, we can conclude that
      fastapi[standard]>=0.115.3,<=0.115.14 depends on typer>=0.12.3.
      And because we know from (13) that fastapi[standard]>=0.115.4 depends on typer>=0.12.3, we can conclude that fastapi[standard]>=0.115.3
      depends on typer>=0.12.3. (14)

      Because fastapi-cli==0.0.10 depends on typer>=0.15.1 and typer>=0.15.1, we can conclude that fastapi-cli[standard]>=0.0.9 depends on
      typer>=0.15.1.
      And because fastapi-cli>=0.0.8 depends on typer>=0.15.1, we can conclude that fastapi-cli[standard]>=0.0.8 depends on typer>=0.15.1.
      And because only the following versions of fastapi-cli[standard] are available:
          fastapi-cli[standard]<=0.0.8
          fastapi-cli[standard]==0.0.9
          fastapi-cli[standard]==0.0.10
      and fastapi-cli==0.0.7 depends on typer>=0.12.3, we can conclude that fastapi-cli[standard]>=0.0.7 depends on typer>=0.12.3.
      And because fastapi-cli>=0.0.6,<=0.0.7 depends on typer>=0.12.3 and typer>=0.12.3, we can conclude that fastapi-cli[standard]>=0.0.5
      depends on typer>=0.12.3.
      And because only the following versions of fastapi-cli[standard] are available:
          fastapi-cli[standard]<=0.0.5
          fastapi-cli[standard]==0.0.6
          fastapi-cli[standard]==0.0.7
          fastapi-cli[standard]>=0.0.8
      and fastapi[standard]>=0.115.2,<=0.115.14 depends on fastapi-cli[standard]>=0.0.5, we can conclude that
      fastapi[standard]>=0.115.2,<=0.115.14 depends on typer>=0.12.3.
      And because we know from (14) that fastapi[standard]>=0.115.3 depends on typer>=0.12.3, we can conclude that fastapi[standard]>=0.115.2
      depends on typer>=0.12.3. (15)

      Because fastapi-cli==0.0.10 depends on typer>=0.15.1 and typer>=0.15.1, we can conclude that fastapi-cli[standard]>=0.0.9 depends on
      typer>=0.15.1.
      And because fastapi-cli>=0.0.8 depends on typer>=0.15.1, we can conclude that fastapi-cli[standard]>=0.0.8 depends on typer>=0.15.1.
      And because only the following versions of fastapi-cli[standard] are available:
          fastapi-cli[standard]<=0.0.8
          fastapi-cli[standard]==0.0.9
          fastapi-cli[standard]==0.0.10
      and fastapi-cli==0.0.7 depends on typer>=0.12.3, we can conclude that fastapi-cli[standard]>=0.0.7 depends on typer>=0.12.3.
      And because fastapi-cli>=0.0.6,<=0.0.7 depends on typer>=0.12.3 and typer>=0.12.3, we can conclude that fastapi-cli[standard]>=0.0.5
      depends on typer>=0.12.3.
      And because only the following versions of fastapi-cli[standard] are available:
          fastapi-cli[standard]<=0.0.5
          fastapi-cli[standard]==0.0.6
          fastapi-cli[standard]==0.0.7
          fastapi-cli[standard]>=0.0.8
      and fastapi[standard]>=0.115.1,<=0.115.14 depends on fastapi-cli[standard]>=0.0.5, we can conclude that
      fastapi[standard]>=0.115.1,<=0.115.14 depends on typer>=0.12.3.
      And because we know from (15) that fastapi[standard]>=0.115.2 depends on typer>=0.12.3, we can conclude that fastapi[standard]>=0.115.1
      depends on typer>=0.12.3. (16)

      Because fastapi-cli==0.0.10 depends on typer>=0.15.1 and typer>=0.15.1, we can conclude that fastapi-cli[standard]>=0.0.9 depends on
      typer>=0.15.1.
      And because fastapi-cli>=0.0.8 depends on typer>=0.15.1, we can conclude that fastapi-cli[standard]>=0.0.8 depends on typer>=0.15.1.
      And because only the following versions of fastapi-cli[standard] are available:
          fastapi-cli[standard]<=0.0.8
          fastapi-cli[standard]==0.0.9
          fastapi-cli[standard]==0.0.10
      and fastapi-cli==0.0.7 depends on typer>=0.12.3, we can conclude that fastapi-cli[standard]>=0.0.7 depends on typer>=0.12.3.
      And because fastapi-cli>=0.0.6,<=0.0.7 depends on typer>=0.12.3 and typer>=0.12.3, we can conclude that fastapi-cli[standard]>=0.0.5
      depends on typer>=0.12.3.
      And because only the following versions of fastapi-cli[standard] are available:
          fastapi-cli[standard]<=0.0.5
          fastapi-cli[standard]==0.0.6
          fastapi-cli[standard]==0.0.7
          fastapi-cli[standard]>=0.0.8
      and fastapi[standard]>=0.115.0,<=0.115.14 depends on fastapi-cli[standard]>=0.0.5, we can conclude that
      fastapi[standard]>=0.115.0,<=0.115.14 depends on typer>=0.12.3.
      And because we know from (16) that fastapi[standard]>=0.115.1 depends on typer>=0.12.3, we can conclude that fastapi[standard]>=0.115.0
      depends on typer>=0.12.3.
      And because spacy==3.7.0 depends on typer>=0.3.0,<0.10.0, we can conclude that spacy==3.7.0 and fastapi[standard]>=0.115.0 are
      incompatible.
      And because py-data-juicer==1.4.0 depends on spacy==3.7.0 and only the following versions of py-data-juicer are available:
          py-data-juicer<=1.4.0
          py-data-juicer==1.4.1
          py-data-juicer==1.4.2
      we can conclude that py-data-juicer>=1.4.0,<1.4.1 and fastapi[standard]>=0.115.0 are incompatible. (17)

      Because spacy==3.8.0 was yanked (reason: model compatibility problem) and py-data-juicer>=1.4.1 depends on spacy==3.8.0, we can conclude
      that py-data-juicer>=1.4.1 cannot be used.
      And because we know from (17) that py-data-juicer>=1.4.0,<1.4.1 and fastapi[standard]>=0.115.0 are incompatible, we can conclude that
      py-data-juicer>=1.4.0 and fastapi[standard]>=0.115.0 are incompatible.
      And because trinity-rft[data] depends on py-data-juicer>=1.4 and only the following versions of fastapi[standard] are available:
          fastapi[standard]<=0.115.0
          fastapi[standard]==0.115.1
          fastapi[standard]==0.115.2
          fastapi[standard]==0.115.3
          fastapi[standard]==0.115.4
          fastapi[standard]==0.115.5
          fastapi[standard]==0.115.6
          fastapi[standard]==0.115.7
          fastapi[standard]==0.115.8
          fastapi[standard]==0.115.9
          fastapi[standard]==0.115.10
          fastapi[standard]==0.115.11
          fastapi[standard]==0.115.12
          fastapi[standard]==0.115.13
          fastapi[standard]==0.115.14
          fastapi[standard]==0.116.0
          fastapi[standard]==0.116.1
      we can conclude that trinity-rft[data] and fastapi[standard]>=0.115.0 are incompatible.
      And because vllm>=0.9.1,<=0.10.0 depends on fastapi[standard]>=0.115.0 and only the following versions of vllm are available:
          vllm<=0.9.1
          vllm==0.9.2
          vllm>=0.10.0
      we can conclude that trinity-rft[data] and vllm>=0.9.1,<=0.10.0 are incompatible.
      And because your project depends on vllm>=0.9.1,<=0.10.0 and your project requires trinity-rft[data], we can conclude that your project's
      requirements are unsatisfiable.

      hint: While the active Python version is 3.12, the resolution failed for other Python versions supported by your project. Consider
      limiting your project's supported Python versions using `requires-python`.

[vadimkantorov]

@hiyuchang I would suggest it's important to fix these dependencies issues before 0.3.0. Being able to just uv sync or uv run would be a great feature for 0.3.0

[vadimkantorov]

The real fix would be to have rm-gallery and data-juicer folks push out new PyPi service releases and depend on the new versions:

cc @pan-x-c

[pan-x-c]

data-juicer and rm-gallery have their own release frequency. In my opinion, the official release should not depend on a development version. We will try to contact the corresponding repository owner to see if the dependency conflict can be resolved in the near future. If not, uv support will be postponed to 0.3.1.

[pan-x-c]

We provided preliminary support for uv in v0.3.0. If you encounter any problems when using uv, please continue to report them in this issue

[vadimkantorov]

Thank you!

Going forward, after the new releases of rm-gallery/data-juicer are published to PyPi, it would be good to have an example of using "py_executable": "uv run" with ray job submit, this allows to nicely have Ray nicely pull all dependencies in exactly the same quirks

It would also be good to add a test in CI which clones trinity and tests if uv sync is working well

One other thing to note: currently flash-attention is built from sources (when installing it from pip/uv). For avoiding this, wheel URLs to binaries like https://github.com/Dao-AILab/flash-attention/releases/download/v2.8.3/flash_attn-2.8.3+cu12torch2.8cxx11abiTRUE-cp312-cp312-linux_x86_64.whl must be specified in pyproject.toml. Or a special index HTML page created: Dao-AILab/flash-attention#1874 (comment)

[vadimkantorov]

@pan-x-c data-juicer 1.4.3 got released which fixes the spacy dependency:

• https://github.com/modelscope/data-juicer/releases/tag/v1.4.3

Could Trinity be updated to depend on data-juicer>=1.4.3 instead of data-juicer>=1.4? Or will it now automatically to install 1.4.3?

[vadimkantorov]

but rm-gallery seems to have made no releases last several months. maybe you could contact them and ask to push out a service release...

[chenyushuo]

We have upgraded the version of data-juicer to 1.4.3 in #286, and contact the team of rm-gallery to fix some package dependencies.

[vadimkantorov]

Yeah, and probably a service release by rm-gallery would be needed...

[pan-x-c]

RM-Gallery has released 0.1.5