[SPARK-43231][ML][PYTHON][CONNECT][TESTS] Reduce the memory requirement in torch-related tests#40874

zhengruifeng wants to merge 11 commits intoapache:masterapache/spark:masterfrom

zhengruifeng:torch_reduce_memoryzhengruifeng/spark:torch_reduce_memoryCopy head branch name to clipboard