Remove importlib-metadata dependency #2288

Job	Run time
Framework / bare	1m 42s
Framework / jax	1m 51s
Framework / pytorch	3m 55s
Framework / tensorflow	3m 48s
Framework / tabnet	3m 3s
Framework / opacus	4m 24s
Framework / pytorch-lightning	3m 7s
Framework / mxnet	1m 51s
Framework / scikit-learn	2m 23s
Framework / fastai	4m 28s
Framework / pandas	1m 35s
Strategy / FedMedian	1m 28s
Strategy / FedTrimmedAvg	1m 31s
Strategy / QFedAvg	1m 56s
Strategy / FaultTolerantFedAvg	1m 31s
Strategy / FedAvgM	1m 43s
Strategy / FedAdam	1m 21s
Strategy / FedAdagrad	1m 41s
Strategy / FedYogi	1m 26s
	44m 44s

Provide feedback