Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

invalid span context noisy logging #6440

Closed
macfarla opened this issue Jan 22, 2024 · 2 comments · Fixed by #6825
Closed

invalid span context noisy logging #6440

macfarla opened this issue Jan 22, 2024 · 2 comments · Fixed by #6825
Assignees
@macfarla
Labels
logging snack Smaller coding task - less than a day for an experienced dev ux

Comments

@macfarla
Copy link
Contributor

Can this log line be moved to TRACE - it's very noisy at DEBUG level

{"@timestamp":"2024-01-22T01:16:50,003","level":"DEBUG","thread":"vert.x-eventloop-thread-1","class":"B3PropagatorExtractorMultipleHeaders","message":"Invalid TraceId in B3 header: null'. Returning INVALID span context.","throwable":""}

{"@timestamp":"2024-01-22T01:16:50,008","level":"DEBUG","thread":"EthScheduler-Services-48 (importBlock)","class":"TransactionLogBloomCacher","message":"Caching logs bloom for block 0x3ce532","throwable":""}
{"@timestamp":"2024-01-22T01:16:50,008","level":"DEBUG","thread":"EthScheduler-Services-48 (importBlock)","class":"TransactionLogBloomCacher","message":"Caching logs bloom for block 0x3ce533","throwable":""}
{"@timestamp":"2024-01-22T01:16:50,008","level":"DEBUG","thread":"vert.x-eventloop-thread-1","class":"B3PropagatorExtractorMultipleHeaders","message":"Invalid TraceId in B3 header: null'. Returning INVALID span context.","throwable":""}
{"@timestamp":"2024-01-22T01:16:50,008","level":"DEBUG","thread":"EthScheduler-Services-48 (importBlock)","class":"TransactionLogBloomCacher","message":"Caching logs bloom for block 0x3ce534","throwable":""}
{"@timestamp":"2024-01-22T01:16:50,009","level":"DEBUG","thread":"vert.x-worker-thread-11","class":"JsonRpcExecutor","message":"JSON-RPC request -> eth_getBlockByNumber ["0x2cac67",false]","throwable":""}
{"@timestamp":"2024-01-22T01:16:50,010","level":"DEBUG","thread":"EthScheduler-Services-48 (importBlock)","class":"TransactionLogBloomCacher","message":"Caching logs bloom for block 0x3ce535","throwable":""}
{"@timestamp":"2024-01-22T01:16:50,010","level":"DEBUG","thread":"vert.x-eventloop-thread-1","class":"B3PropagatorExtractorMultipleHeaders","message":"Invalid TraceId in B3 header: null'. Returning INVALID span context.","throwable":""}
{"@timestamp":"2024-01-22T01:16:50,010","level":"DEBUG","thread":"vert.x-worker-thread-18","class":"JsonRpcExecutor","message":"JSON-RPC request -> eth_getBlockByNumber ["0x2cac68",false]","throwable":""}
{"@timestamp":"2024-01-22T01:16:50,010","level":"DEBUG","thread":"EthScheduler-Services-48 (importBlock)","class":"TransactionLogBloomCacher","message":"Caching logs bloom for block 0x3ce536","throwable":""}
{"@timestamp":"2024-01-22T01:16:50,011","level":"DEBUG","thread":"vert.x-eventloop-thread-1","class":"B3PropagatorExtractorMultipleHeaders","message":"Invalid TraceId in B3 header: null'. Returning INVALID span context.","throwable":""}
{"@timestamp":"2024-01-22T01:16:50,011","level":"DEBUG","thread":"EthScheduler-Services-48 (importBlock)","class":"TransactionLogBloomCacher","message":"Caching logs bloom for block 0x3ce537","throwable":""}
{"@timestamp":"2024-01-22T01:16:50,011","level":"DEBUG","thread":"vert.x-worker-thread-3","class":"JsonRpcExecutor","message":"JSON-RPC request -> eth_getBlockByNumber ["0x2cac69",false]","throwable":""}
{"@timestamp":"2024-01-22T01:16:50,012","level":"DEBUG","thread":"vert.x-eventloop-thread-1","class":"B3PropagatorExtractorMultipleHeaders","message":"Invalid TraceId in B3 header: null'. Returning INVALID span context.","throwable":""}
{"@timestamp":"2024-01-22T01:16:50,012","level":"DEBUG","thread":"vert.x-worker-thread-7","class":"JsonRpcExecutor","message":"JSON-RPC request -> eth_getBlockByNumber ["0x2cac6a",false]","throwable":""}
{"@timestamp":"2024-01-22T01:16:50,013","level":"DEBUG","thread":"EthScheduler-Services-48 (importBlock)","class":"TransactionLogBloomCacher","message":"Caching logs bloom for block 0x3ce538","throwable":""}
{"@timestamp":"2024-01-22T01:16:50,013","level":"DEBUG","thread":"EthScheduler-Services-48 (importBlock)","class":"TransactionLogBloomCacher","message":"Caching logs bloom for block 0x3ce539","throwable":""}
{"@timestamp":"2024-01-22T01:16:50,014","level":"DEBUG","thread":"vert.x-eventloop-thread-1","class":"B3PropagatorExtractorMultipleHeaders","message":"Invalid TraceId in B3 header: null'. Returning INVALID span context.","throwable":""}
{"@timestamp":"2024-01-22T01:16:50,014","level":"DEBUG","thread":"vert.x-worker-thread-4","class":"JsonRpcExecutor","message":"JSON-RPC request -> eth_getBlockByNumber ["0x2cac6b",false]","throwable":""}

maybe some context here #3184
@macfarla
Copy link
Contributor Author

workaround to turn it down -

curl -X POST --data '{"jsonrpc":"2.0", "method":"admin_changeLogLevel", "params":["INFO", ["io.opentelemetry.extension.trace.propagation"]], "id":1}' http://127.0.0.1:8545

@non-fungible-nelson non-fungible-nelson added the snack Smaller coding task - less than a day for an experienced dev label Jan 22, 2024
@macfarla
Copy link
Contributor Author

FYI #6422 (comment) still happening even with otel upgrade

@macfarla macfarla mentioned this issue Feb 26, 2024
Closed
@macfarla macfarla mentioned this issue Mar 27, 2024
Merged
8 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@macfarla macfarla

Labels
logging snack Smaller coding task - less than a day for an experienced dev ux
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

filtered out the noisy Invalid Trace log messages macfarla/besu
2 participants
@macfarla @non-fungible-nelson