Add testing for PyTorch 2.4 (Trainer) #25785

Job	Run time
build-packages / init	8s
build-packages / build-packages (lightning)	22s
build-packages / build-packages (fabric)	23s
build-packages / build-packages (pytorch)	20s
install-pkg (ubuntu-22.04, fabric, 3.8)	1m 41s
install-pkg (ubuntu-22.04, fabric, 3.11)	1m 40s
install-pkg (ubuntu-22.04, pytorch, 3.8)	1m 52s
install-pkg (ubuntu-22.04, pytorch, 3.11)	2m 21s
install-pkg (ubuntu-22.04, lightning, 3.8)	1m 47s
install-pkg (ubuntu-22.04, lightning, 3.11)	2m 38s
install-pkg (ubuntu-22.04, notset, 3.8)	1m 54s
install-pkg (ubuntu-22.04, notset, 3.11)	2m 30s
install-pkg (macOS-12, fabric, 3.8)	1m 7s
install-pkg (macOS-12, fabric, 3.11)	1m 5s
install-pkg (macOS-12, pytorch, 3.8)	1m 15s
install-pkg (macOS-12, pytorch, 3.11)	1m 30s
install-pkg (macOS-12, lightning, 3.8)	1m 6s
install-pkg (macOS-12, lightning, 3.11)	1m 6s
install-pkg (macOS-12, notset, 3.8)	1m 8s
install-pkg (macOS-12, notset, 3.11)	1m 18s
install-pkg (windows-2022, fabric, 3.8)	1m 57s
install-pkg (windows-2022, fabric, 3.11)	2m 0s
install-pkg (windows-2022, pytorch, 3.8)	2m 30s
install-pkg (windows-2022, pytorch, 3.11)	2m 20s
install-pkg (windows-2022, lightning, 3.8)	3m 7s
install-pkg (windows-2022, lightning, 3.11)	2m 39s
install-pkg (windows-2022, notset, 3.8)	2m 3s
install-pkg (windows-2022, notset, 3.11)	2m 24s
	46m 11s

Provide feedback