Rust linux-build frequently timeout

[jackye1995]

e.g. https://github.com/lance-format/lance/actions/runs/21269824380/job/61217409096?pr=5793

[wjones127]

I was going to say maybe the problem is compilation, but really it's tests that are taking most of the time. I'll look which tests we can make faster.

[wjones127]

Working on this in #5814