3.11 backtrace visual indicators are too verbose #93883

belm0 · 2022-06-16T01:46:13Z

I understand that the new visual indicators can be disabled, but we shouldn't have to choose between guaranteed 50% longer backtraces and pertinent column information.

Often, the visual indicator spans the entire line for a large percentage of the backtrace. (I've seen cases in our app where it's true for 100% of the backtrace.)

Proposal: elide the indicators when they span the whole line

Elide traceback column indicators when the entire line of the frame is implicated. This reduces traceback length and draws more attention to the remaining (very relevant) indicators.

before:

Traceback (most recent call last):
  File "query.py", line 99, in <module>
    bar()
    ^^^^^
  File "query.py", line 66, in bar
    foo()
    ^^^^^
  File "query.py", line 37, in foo
    magic_arithmetic('foo')
    ^^^^^^^^^^^^^^^^^^^^^^^
  File "query.py", line 18, in magic_arithmetic
    return add_counts(x) / 25
           ^^^^^^^^^^^^^
  File "query.py", line 24, in add_counts
    return 25 + query_user(user1) + query_user(user2)
                ^^^^^^^^^^^^^^^^^
  File "query.py", line 32, in query_user
    return 1 + query_count(db, response['a']['b']['c']['user'], retry=True)
                               ~~~~~~~~~~~~~~~~~~^^^^^
TypeError: 'NoneType' object is not subscriptable

after:

Traceback (most recent call last):
  File "query.py", line 99, in <module>
    bar()
  File "query.py", line 66, in bar
    foo()
  File "query.py", line 37, in foo
    magic_arithmetic('foo')
  File "query.py", line 18, in magic_arithmetic
    return add_counts(x) / 25
           ^^^^^^^^^^^^^
  File "query.py", line 24, in add_counts
    return 25 + query_user(user1) + query_user(user2)
                ^^^^^^^^^^^^^^^^^
  File "query.py", line 32, in query_user
    return 1 + query_count(db, response['a']['b']['c']['user'], retry=True)
                               ~~~~~~~~~~~~~~~~~~^^^^^
TypeError: 'NoneType' object is not subscriptable

The text was updated successfully, but these errors were encountered:

belm0 · 2022-06-19T05:10:09Z

I've prototyped the change for traceback.py. Making the equivalent change to C traceback code and updating documentation is still required. I'd like to hear if this change has some support from Python devs before putting more time into the PR.

Zac-HD · 2022-06-23T05:43:11Z

I am very, very keen on this change! Thanks very much @belm0 for thinking of this and implementing a patch 😍

Elide traceback column indicators when the entire line of the frame is implicated. This reduces traceback length and draws even more attention to the remaining (very relevant) indicators. Example: ``` Traceback (most recent call last): File "query.py", line 99, in <module> bar() File "query.py", line 66, in bar foo() File "query.py", line 37, in foo magic_arithmetic('foo') File "query.py", line 18, in magic_arithmetic return add_counts(x) / 25 ^^^^^^^^^^^^^ File "query.py", line 24, in add_counts return 25 + query_user(user1) + query_user(user2) ^^^^^^^^^^^^^^^^^ File "query.py", line 32, in query_user return 1 + query_count(db, response['a']['b']['c']['user'], retry=True) ~~~~~~~~~~~~~~~~~~^^^^^ TypeError: 'NoneType' object is not subscriptable ``` WORK IN PROGRESS TODO: * C traceback implementation * update documentation

belm0 · 2022-06-24T14:28:02Z

PR #93994 is ready for review

* gh-93883: elide traceback indicators when possible Elide traceback column indicators when the entire line of the frame is implicated. This reduces traceback length and draws even more attention to the remaining (very relevant) indicators. Example: ``` Traceback (most recent call last): File "query.py", line 99, in <module> bar() File "query.py", line 66, in bar foo() File "query.py", line 37, in foo magic_arithmetic('foo') File "query.py", line 18, in magic_arithmetic return add_counts(x) / 25 ^^^^^^^^^^^^^ File "query.py", line 24, in add_counts return 25 + query_user(user1) + query_user(user2) ^^^^^^^^^^^^^^^^^ File "query.py", line 32, in query_user return 1 + query_count(db, response['a']['b']['c']['user'], retry=True) ~~~~~~~~~~~~~~~~~~^^^^^ TypeError: 'NoneType' object is not subscriptable ``` Rather than going out of our way to provide indicator coverage in every traceback test suite, the indicator test suite should be responible for sufficient coverage (e.g. by adding a basic exception group test to ensure that margin strings are covered).

) * pythongh-93883: elide traceback indicators when possible Elide traceback column indicators when the entire line of the frame is implicated. This reduces traceback length and draws even more attention to the remaining (very relevant) indicators. Example: ``` Traceback (most recent call last): File "query.py", line 99, in <module> bar() File "query.py", line 66, in bar foo() File "query.py", line 37, in foo magic_arithmetic('foo') File "query.py", line 18, in magic_arithmetic return add_counts(x) / 25 ^^^^^^^^^^^^^ File "query.py", line 24, in add_counts return 25 + query_user(user1) + query_user(user2) ^^^^^^^^^^^^^^^^^ File "query.py", line 32, in query_user return 1 + query_count(db, response['a']['b']['c']['user'], retry=True) ~~~~~~~~~~~~~~~~~~^^^^^ TypeError: 'NoneType' object is not subscriptable ``` Rather than going out of our way to provide indicator coverage in every traceback test suite, the indicator test suite should be responible for sufficient coverage (e.g. by adding a basic exception group test to ensure that margin strings are covered). (cherry picked from commit da71751) Co-authored-by: John Belmonte <john@neggie.net>

PR #93994 was merged without being rebased in a few weeks, and some new test code using the old scheme passed through automatic merge.

…onGH-93994) * pythongh-93883: elide traceback indicators when possible Elide traceback column indicators when the entire line of the frame is implicated. This reduces traceback length and draws even more attention to the remaining (very relevant) indicators. Example: ``` Traceback (most recent call last): File "query.py", line 99, in <module> bar() File "query.py", line 66, in bar foo() File "query.py", line 37, in foo magic_arithmetic('foo') File "query.py", line 18, in magic_arithmetic return add_counts(x) / 25 ^^^^^^^^^^^^^ File "query.py", line 24, in add_counts return 25 + query_user(user1) + query_user(user2) ^^^^^^^^^^^^^^^^^ File "query.py", line 32, in query_user return 1 + query_count(db, response['a']['b']['c']['user'], retry=True) ~~~~~~~~~~~~~~~~~~^^^^^ TypeError: 'NoneType' object is not subscriptable ``` (cherry picked from commit da71751) Co-authored-by: John Belmonte <john@neggie.net>

…#94737) PR python#93994 was merged without being rebased in a few weeks, and some new test code using the old scheme passed through automatic merge. (cherry picked from commit 1fdc35e)

…onGH-93994) * pythongh-93883: elide traceback indicators when possible Elide traceback column indicators when the entire line of the frame is implicated. This reduces traceback length and draws even more attention to the remaining (very relevant) indicators. Example: ``` Traceback (most recent call last): File "query.py", line 99, in <module> bar() File "query.py", line 66, in bar foo() File "query.py", line 37, in foo magic_arithmetic('foo') File "query.py", line 18, in magic_arithmetic return add_counts(x) / 25 ^^^^^^^^^^^^^ File "query.py", line 24, in add_counts return 25 + query_user(user1) + query_user(user2) ^^^^^^^^^^^^^^^^^ File "query.py", line 32, in query_user return 1 + query_count(db, response['a']['b']['c']['user'], retry=True) ~~~~~~~~~~~~~~~~~~^^^^^ TypeError: 'NoneType' object is not subscriptable ``` Rather than going out of our way to provide indicator coverage in every traceback test suite, the indicator test suite should be responible for sufficient coverage (e.g. by adding a basic exception group test to ensure that margin strings are covered).. (cherry picked from commit da71751) Co-authored-by: John Belmonte <john@neggie.net>

…H-94740) Elide traceback column indicators when the entire line of the frame is implicated. This reduces traceback length and draws more attention to the remaining (very relevant) indicators. Example: ``` Traceback (most recent call last): File "query.py", line 99, in <module> bar() File "query.py", line 66, in bar foo() File "query.py", line 37, in foo magic_arithmetic('foo') File "query.py", line 18, in magic_arithmetic return add_counts(x) / 25 ^^^^^^^^^^^^^ File "query.py", line 24, in add_counts return 25 + query_user(user1) + query_user(user2) ^^^^^^^^^^^^^^^^^ File "query.py", line 32, in query_user return 1 + query_count(db, response['a']['b']['c']['user'], retry=True) ~~~~~~~~~~~~~~~~~~^^^^^ TypeError: 'NoneType' object is not subscriptable ``` Automerge-Triggered-By: GH:pablogsal

belm0 · 2022-07-11T11:54:30Z

The refinement is merged and backported to 3.11 for the beta4 release.

…rmat See python/cpython#93883 and python/cpython#93994 Fixes pytest-dev#10131

…rmat See python/cpython#93883 and python/cpython#93994

belm0 added the type-bug An unexpected behavior, bug, or error label Jun 16, 2022

arhadthedev mentioned this issue Jun 19, 2022

gh-93883: elide traceback indicators when possible #93994

Merged

2 tasks

miss-islington mentioned this issue Jul 11, 2022

[3.11] gh-93883: elide traceback indicators when possible (GH-93994) #94734

Closed

AlexWaygood mentioned this issue Jul 11, 2022

gh-93883: Fix some test involving traceback formatting #94737

Merged

pablogsal pushed a commit that referenced this issue Jul 11, 2022

gh-93883: Fix some tests involving traceback formatting (#94737)

1fdc35e

PR #93994 was merged without being rebased in a few weeks, and some new test code using the old scheme passed through automatic merge.

bedevere-bot mentioned this issue Jul 11, 2022

[3.11] gh-93883: elide traceback indicators when possible (GH-93994) #94740

Merged

belm0 closed this as completed Jul 11, 2022

hroncok added a commit to hroncok/pytest that referenced this issue Jul 13, 2022

Adjust tests for a last minute Python 3.11 change in the traceback fo…

f33070e

…rmat See python/cpython#93883 and python/cpython#93994 Fixes pytest-dev#10131

hroncok mentioned this issue Jul 13, 2022

Adjust tests for a last minute Python 3.11 change in the traceback format pytest-dev/pytest#10132

Merged

hroncok added a commit to hroncok/pytest that referenced this issue Jul 13, 2022

Adjust tests for a last minute Python 3.11 change in the traceback fo…

09b2c95

…rmat See python/cpython#93883 and python/cpython#93994 Fixes pytest-dev#10131

hroncok mentioned this issue Jul 15, 2022

Adjust traceback-matching patterns in tests for Python 3.11 cherrypy/cherrypy#1965

Closed

15 tasks

nitzmahone pushed a commit to rolpdog/cffi-mirror that referenced this issue Sep 8, 2022

Adjust tests for a last minute Python 3.11 change in the traceback fo…

33a9713

…rmat See python/cpython#93883 and python/cpython#93994

nitzmahone pushed a commit to rolpdog/cffi-mirror that referenced this issue Sep 9, 2022

Adjust tests for a last minute Python 3.11 change in the traceback fo…

142ee0c

…rmat See python/cpython#93883 and python/cpython#93994

Zac-HD mentioned this issue Nov 7, 2022

Elide uninformative traceback indicators in return and simple assignment statements #99180

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

3.11 backtrace visual indicators are too verbose #93883

3.11 backtrace visual indicators are too verbose #93883

belm0 commented Jun 16, 2022 •

edited

Loading

belm0 commented Jun 19, 2022

Zac-HD commented Jun 23, 2022

belm0 commented Jun 24, 2022 •

edited

Loading

belm0 commented Jul 11, 2022

3.11 backtrace visual indicators are too verbose #93883

3.11 backtrace visual indicators are too verbose #93883

Comments

belm0 commented Jun 16, 2022 • edited Loading

Proposal: elide the indicators when they span the whole line

belm0 commented Jun 19, 2022

Zac-HD commented Jun 23, 2022

belm0 commented Jun 24, 2022 • edited Loading

belm0 commented Jul 11, 2022

belm0 commented Jun 16, 2022 •

edited

Loading

belm0 commented Jun 24, 2022 •

edited

Loading