running on highway_env is very slow

[huang6668]

• I have marked all applicable categories:
  • exception-raising bug
  • RL algorithm bug
  • documentation request (i.e. "X is missing from the documentation.")
  • new feature request
• I have visited the source website
• I have searched through the issue tracker for duplicates
• I have mentioned version numbers, operating system and environment, where applicable:

  import tianshou, gymnasium as gym, torch, numpy, sys
  print(tianshou.__version__, gym.__version__, torch.__version__, numpy.__version__, sys.version, sys.platform)

It appears that running DQN with tianshou on highway_env is very slow, while it doesn't have the same issue when running on CartPole.

[Trinkle23897]

It's expected because highway_env is not as fast as cartpole

[huang6668]

Thank you so much for your help! Your solution worked perfectly and I really appreciate your time and effort in helping me