Skip to content

[SPARK-54662][PYTHON] Add viztracer and debugpy in dev/requirements.txt#53419

Closed
zhengruifeng wants to merge 1 commit intoapache:masterfrom
zhengruifeng:req_debug
Closed

[SPARK-54662][PYTHON] Add viztracer and debugpy in dev/requirements.txt#53419
zhengruifeng wants to merge 1 commit intoapache:masterfrom
zhengruifeng:req_debug

Conversation

@zhengruifeng
Copy link
Contributor

What changes were proposed in this pull request?

Add viztracer and debugpy in dev/requirements.txt

Why are the changes needed?

for code contributors, the new packages will be installed in pip install -r dev/requirements.txt

Does this PR introduce any user-facing change?

no, dev-only

How was this patch tested?

manually check pip install -r dev/requirements.txt

Was this patch authored or co-authored using generative AI tooling?

no

@github-actions github-actions bot added the BUILD label Dec 10, 2025
graphviz==0.20.3
flameprof==0.4
viztracer
debugpy
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

# Debug for Spark and Spark Connect
graphviz==0.20.3
flameprof==0.4
viztracer
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1 for Apache Spark 4.2.0.

# Debug for Spark and Spark Connect
graphviz==0.20.3
flameprof==0.4
viztracer
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Shall we fix the version or add a min version?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@gaogaotiantian do we need a min version?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think using the latest one should be good. I'll pin it if I have any breaking changes.

@zhengruifeng zhengruifeng deleted the req_debug branch December 11, 2025 00:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants