python -m tokenize is broken when reading from stdin

[pablogsal]

 ./python.exe -m tokenize <<< 'f"{F():\n}"'
unexpected error: 'generator' object is not callable
Traceback (most recent call last):
  File "/Users/pgalindo3/github/python/main/Lib/runpy.py", line 198, in _run_module_as_main
    return _run_code(code, main_globals, None,
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/pgalindo3/github/python/main/Lib/runpy.py", line 88, in _run_code
    exec(code, run_globals)
  File "/Users/pgalindo3/github/python/main/Lib/tokenize.py", line 532, in <module>
    main()
  File "/Users/pgalindo3/github/python/main/Lib/tokenize.py", line 498, in main
    for token in tokens:
  File "/Users/pgalindo3/github/python/main/Lib/tokenize.py", line 527, in _generate_tokens_from_c_tokenizer
    for info in it:
TypeError: 'generator' object is not callable

Linked PRs

• gh-105324: Fix tokenize module main function for stdin #105325
• [3.12] gh-105324: Fix tokenize module main function for stdin (GH-105325) #105330