Update Dependency Versions

[songzhi]

I see that many dependency library versions are quite old, perhaps they can be upgraded to the latest version?

[wangrunji0408]

We support a minimum Python version of 3.8. However, many of the latest versions of dependencies no longer support it. As a result, these dependencies have been kept at their current versions.

[iamthebot]

@wangrunji0408 unfortunately you're still using ~= pins for critical packages like pyarrow, etc. This causes major dependency conflicts. It's best practice to use >= for packages like pyarrow and let the pip/conda solver handle other constraints from transitive dependencies, etc. If in your own deployments you require those versions you can always use lockfiles, etc.

eg; in the conda-forge feedstock PR I've had to remove those ~= pins.