Remove numpy from base requirements #25861

Job	Run time
build-packages / init	5s
build-packages / build-packages (lightning)	25s
build-packages / build-packages (fabric)	25s
build-packages / build-packages (pytorch)	20s
install-pkg (ubuntu-22.04, fabric, 3.9)	1m 41s
install-pkg (ubuntu-22.04, fabric, 3.11)	1m 38s
install-pkg (ubuntu-22.04, pytorch, 3.9)	1m 50s
install-pkg (ubuntu-22.04, pytorch, 3.11)	1m 46s
install-pkg (ubuntu-22.04, lightning, 3.9)	1m 47s
install-pkg (ubuntu-22.04, lightning, 3.11)	1m 45s
install-pkg (ubuntu-22.04, notset, 3.9)	2m 2s
install-pkg (ubuntu-22.04, notset, 3.11)	1m 46s
install-pkg (macOS-12, fabric, 3.9)	1m 5s
install-pkg (macOS-12, fabric, 3.11)	57s
install-pkg (macOS-12, pytorch, 3.9)	1m 28s
install-pkg (macOS-12, pytorch, 3.11)	1m 1s
install-pkg (macOS-12, lightning, 3.9)	1m 18s
install-pkg (macOS-12, lightning, 3.11)	1m 12s
install-pkg (macOS-12, notset, 3.9)	1m 17s
install-pkg (macOS-12, notset, 3.11)	1m 5s
install-pkg (windows-2022, fabric, 3.9)	2m 21s
install-pkg (windows-2022, fabric, 3.11)	2m 17s
install-pkg (windows-2022, pytorch, 3.9)	2m 23s
install-pkg (windows-2022, pytorch, 3.11)	2m 0s
install-pkg (windows-2022, lightning, 3.9)	2m 41s
install-pkg (windows-2022, lightning, 3.11)	2m 43s
install-pkg (windows-2022, notset, 3.9)	3m 15s
install-pkg (windows-2022, notset, 3.11)	2m 27s
	45m 0s

Provide feedback