Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

BallistaContext::collect() logging is too noisy #352

Closed
andygrove opened this issue May 16, 2021 · 0 comments · Fixed by #394
Closed

BallistaContext::collect() logging is too noisy #352

andygrove opened this issue May 16, 2021 · 0 comments · Fixed by #394
Labels
enhancement New feature or request good first issue Good for newcomers

Comments

@andygrove
Copy link
Member

Is your feature request related to a problem or challenge? Please describe what you are trying to do.

When running benchmarks, I see pages of this output and I lose the output I care about.

[2021-05-16T14:01:49Z INFO  ballista::context] Job FobBz8Q is running...
[2021-05-16T14:01:49Z INFO  ballista::context] Job FobBz8Q is running...
[2021-05-16T14:01:49Z INFO  ballista::context] Job FobBz8Q is running...
[2021-05-16T14:01:49Z INFO  ballista::context] Job FobBz8Q is running...
[2021-05-16T14:01:49Z INFO  ballista::context] Job FobBz8Q is running...
[2021-05-16T14:01:49Z INFO  ballista::context] Job FobBz8Q is running...
[2021-05-16T14:01:49Z INFO  ballista::context] Job FobBz8Q is running...
[2021-05-16T14:01:50Z INFO  ballista::context] Job FobBz8Q is running...
[2021-05-16T14:01:50Z INFO  ballista::context] Job FobBz8Q is running...
[2021-05-16T14:01:50Z INFO  ballista::context] Job FobBz8Q is running...

Describe the solution you'd like
We should either change the log level of this message to TRACE or consider a different approach to keeping the user informed about job status.

Describe alternatives you've considered
None

Additional context
None
@andygrove andygrove added enhancement New feature or request ballista good first issue Good for newcomers labels May 16, 2021
jgoday added a commit to jgoday/arrow-datafusion that referenced this issue May 23, 2021
@jgoday
apache#352: BallistaContext::collect() logging is too noisy, change i…
b9bf5dc 
…nfo messages for trace inside collect loop

# Please enter the commit message for your changes. Lines starting
# with '#' will be kept; you may remove them yourself if you want to.
# An empty message aborts the commit.
#
# Date:      Sun May 23 12:07:25 2021 +0200
#
# On branch ballista_context_collect_info
# Changes to be committed:
#	modified:   ballista/rust/client/src/context.rs
#
@jgoday jgoday mentioned this issue May 23, 2021
Merged
jgoday added a commit to jgoday/arrow-datafusion that referenced this issue May 23, 2021
@jgoday
apache#352: BallistaContext::collect() logging is too noisy, change i…
b1642be 
…nfo messages for trace inside collect loop
andygrove pushed a commit that referenced this issue May 27, 2021
@jgoday
#352: BallistaContext::collect() logging is too noisy (#394)
3f7736c
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request good first issue Good for newcomers
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

#352: BallistaContext::collect() logging is too noisy jgoday/arrow-datafusion
1 participant
@andygrove